AWS Robotics Blog
Testing map generation at scale with 3D worlds from AWS WorldForge
This blog uses colcon bundle for robot and simulation applications. AWS RoboMaker now only supports containers to make it easy for you to bring and run your own simulations and applications. To follow along with this blog post, see our updated blog on Preparing ROS application and simulation application containers for AWS RoboMaker.
In this blog, learn about AWS RoboMaker WorldForge, and how 3D world generation can be used to streamline testing and training of core robotic algorithms at scale.
Introducing AWS WorldForge:
Mapping algorithms and localization accuracy is fundamental to robotics applications, be it a cleaning robot within a home or an Autonomous Mobile Robot (AMR) in a warehouse environment. 3D Simulation of robots enables up front testing of algorithms resulting in reduced quantity, frequency and time take to fix errors discovered in the field. Real world errors and long periods of downtime create a negative end user experience, and can erode customer trust in the robotics company and the robot itself. Setting up the infrastructure to create 3D simulation worlds to test these algorithms is costly, complex and resource-intensive. Varieties of worlds are required to effectively test for issues seen in the real world. As a result, resources required to build these 3D simulation worlds deters robotics companies from using simulation-based testing approaches at scale.
AWS RoboMaker WorldForge makes it faster, simpler, and less expensive to generate a multitude of virtual 3D worlds with a single API call. This ability to generate worlds with an API removes the complexity and high cost of creating the vitally needed variety in the simulation worlds, and provides direct integration with AWS RoboMaker simulation jobs. We cover this in the next three sections.
In the first section, you learn how to use AWS RoboMaker WorldForge to generate 3D simulation worlds, or “WorldForge worlds”. This is done by creating a simulation world template that uses a collection of parameters to determine how to generate new worlds. We then create 3D simulation worlds from a simulation world template by calling the create world generation job API.
In the second section, you will set up an open-sourced sample application provided to run on AWS RobMaker. In the sample application, a virtual robot explores a WorldForge world and creates a map. The sample application uses the expore_lite exploration Robot Operating System(ROS) package with move_base and gmapping ROS packages to create a map of the WorldForge world.
In the final section, you run the sample application with multiple 3D worlds concurrently, by creating an AWS RoboMaker batch simulation job. AWS RoboMaker imports the WorldForge worlds seamlessly into your simulation application based on the configuration provided. By adding a custom upload configuration to an AWS RoboMaker simulation job the generated map files from all the AWS RoboMaker simulation jobs are uploaded to Amazon Simple Storage Service (Amazon S3) bucket. Your Quality Assurance (QA) engineers and robotics developers can then access and determine which environments and tests are challenging for the robot, and which corresponding worlds can be used in subsequent tests to verify the improvements.
Prerequisites:
You must have an Ubuntu 18.04 machine. The machine needs the ROS Melodic environment with colcon, colcon bundle, rosws and the AWS Command Line Interface (AWS CLI) setup, along with the credentials to upload files to Amazon S3 and make AWS RoboMaker API calls.
Creating WorldForge worlds:
To create a set of WorldForge worlds, you create a simulation world template that uses a collection of parameters and components to determine how to generate the new worlds. Components include the floor plan, preferences for interior materials, furniture, assets, etc. Learn more about Simulation World Templates here.
Save the following JSON to a file called template.json. The file contains the parameters and the components of the template that describe the world that will be generated.
{
"Version": "1",
"Buildings": [
{
"Floors": [
{
"Floorplan": {
"Ceiling": {
"Height": 3
},
"DesiredConnections": [
{
"ConnectionType": "Doorway",
"Location": [
"Bathroom",
"Livingroom"
]
},
{
"ConnectionType": "Opening",
"Location": [
"Livingroom",
"Kitchen"
]
},
{
"ConnectionType": "Doorway",
"Location": [
"Bedroom",
"Livingroom"
]
}
],
"Footprint": {
"DesiredAspectRatio": {
"x": 1,
"y": 1
}
},
"Rooms": [
{
"DesiredShape": {
"Area": 25,
"AspectRatio": {
"x": 1,
"y": 1.2
}
},
"Name": "Bedroom",
"Type": "Bedroom"
},
{
"DesiredShape": {
"Area": 30,
"AspectRatio": {
"x": 1,
"y": 1.5
}
},
"Name": "Livingroom",
"Type": "Living"
},
{
"DesiredShape": {
"Area": 10,
"AspectRatio": {
"x": 1,
"y": 1.5
}
},
"Name": "Bathroom",
"Type": "Bathroom"
},
{
"DesiredShape": {
"Area": 15,
"AspectRatio": {
"x": 1.5,
"y": 1
}
},
"Name": "Kitchen",
"Type": "Kitchen"
}
]
},
"Interior": {
"Flooring": {
"MaterialSets": [
{
"Name": "Floorboard roomtypes",
"SampleSet": {
"MaterialTypes": [
"Floorboards"
]
},
"TargetSet": {
"RoomTypes": [
"Kitchen"
]
}
},
{
"Name": "Carpet roomtypes",
"SampleSet": {
"MaterialTypes": [
"Carpet"
]
},
"TargetSet": {
"RoomTypes": [
"Living",
"Bedroom"
]
}
},
{
"Name": "Bathroom",
"SampleSet": {
"MaterialTypes": [
"Parquetry"
]
},
"TargetSet": {
"RoomNames": [
"Bathroom"
]
}
}
]
},
"Furniture": {
"FurnitureArrangements": [
{
"DesiredSpatialDensity": "Dense",
"Name": "Dense furniture roomtypes",
"TargetSet": {
"RoomTypes": [
"Living",
"Bedroom",
"Kitchen",
"Bathroom"
]
}
}
]
},
"Walls": {
"MaterialSets": [
{
"Name": "Brick roomtypes",
"SampleSet": {
"MaterialTypes": [
"Brick"
]
},
"TargetSet": {
"RoomTypes": [
"Living"
]
}
},
{
"Name": "Tiles roomtypes",
"SampleSet": {
"MaterialTypes": [
"Tiles"
]
},
"TargetSet": {
"RoomTypes": [
"Bathroom"
]
}
}
]
}
}
}
]
}
]
}
Run the following command in the AWS CLI to create a template named bedroom-house defined by the template JSON file you created preceding. You can also perform the same action via AWS RoboMaker console user interface here:
aws robomaker create-world-template --name single-bedroom-house --template-body file://template.jsonExport the ARN from the response to an environment variable called TEMPLATE_ARN. You will use it to create a batch of simulations later in the blog. The response looks like the following.
{
"arn": <TEMPLATE_ARN>,
"clientRequestToken": <TOKEN>,
"createdAt": "2020-09-28T00:14:45+00:00",
"name": "single-bedroom-house",
"tags": {}
}
Run the following command to export the ARN to an environment variable, and be sure to replace the placeholder TEMPLATE_ARN with the actual ARN from the response
export TEMPLATE_ARN=<TEMPLATE_ARN>The preceding JSON world template body document passed in the API creates a template that makes the generated worlds look like a variation of the following.
Next, generate WorldForge worlds from this template from the AWS CLI. You can select to have different combinations of furniture with a same floor plan, emulating different furniture and their placements, or have different floor plans itself. In this blog, we have five worlds each, for two floor plan variation, taking the total worlds to ten. The default limit for number of WorldForge worlds for each generation job is 50. The total worlds can be in combination of one floor plan with 50 worlds (1×50) or 50 floor plans with one world each (50×1) or any combination in between.
Run the following API command from the AWS CLI to create the worlds.
aws robomaker create-world-generation-job --template $TEMPLATE_ARN --world-count floorplanCount=2,interiorCountPerFloorplan=5Export the ARN from the output of the preceding API call to an environment variable called GENERATION_JOB_ARN. You are using it to create a batch of simulations later within this blog. The response will represent the following.
{
"arn": <GENERATION_JOB_ARN>,
"status": "Pending",
"createdAt": "2020-10-20T15:53:46+00:00",
"clientRequestToken": <TOKEN>,
"template": <TEMPLATE_ARN>,
"worldCount": {
"floorplanCount": 2,
"interiorCountPerFloorplan": 5
},
"tags": {}
}
Export the ARN to an environment variable called GENERATION_JOB_ARN using the following command.
export GENERATION_JOB_ARN=<GENERATION_JOB_ARN>Find out the status of the generation job by running the following command.
aws robomaker describe-world-generation-job --job $GENERATION_JOB_ARNThe world generation command takes minutes to complete.
You can run the describe command occasionally to check the progress. Once the status of the generation job is “Completed”, the response represents the following.
{
"arn": <GENERATION_JOB_ARN>,
"status": "Completed",
"createdAt": "2020-09-28T00:21:02+00:00",
"clientRequestToken": <TOKEN>,
"template": <TEMPLATE_ARN>,
"worldCount": {
"floorplanCount": 2,
"interiorCountPerFloorplan": 5
},
"finishedWorldsSummary": {
"finishedCount": 10,
"succeededWorlds": [
<WORLD_1_ARN>,
<WORLD_2_ARN>,
<WORLD_3_ARN>,
<WORLD_4_ARN>,
<WORLD_4_ARN>,
<WORLD_5_ARN>,
<WORLD_6_ARN>,
<WORLD_7_ARN>,
<WORLD_8_ARN>,
<WORLD_9_ARN>,
<WORLD_10_ARN>,
]
},
"tags": {}
}
You will run the describe-world-generation command once again, and writing the output to a file later within the blog, when creating the configuration for the batch API.
You can view the generation job using the console at the following URL.
https://console.thinkwithwp.com/robomaker/home#worldGenerationJobs
The preceding generation job completed in about 1 minute for the configuration provided and resulted in the worlds that look like the following. You can see five variations of furniture, flooring and other parameters in each of the two floor plans.
To recap, by now you have:
- Created a simulation world template in WorldForge, which contains the parameters and components used to determine the world to be generated.
- Started a generate world job, specifying the number of variations of floor plans, and number of worlds within each floor plan
- Made an API call to describe the generation job, which upon completed gives the WORLD_ARN’s of all the generated worlds
- Exported all the respective ARNs to environment variables.
All the ten 3D WorldForge words were generated with 3 API calls and completed within a couple of minutes! Saving time and effort compared to creating worlds manually in an editor. Let’s now look at the next section, where we learn to prepare the sample application.
Preparing the sample application for AWS RoboMaker:
Clone and build the application using the following commands:
git clone https://github.com/aws-samples/aws-robomaker-worldforge-mapping-evaluation-sample-app.git
cd aws-robomaker-worldforge-mapping-evaluation-sample-app/simulation_ws
rosws update
rosdep update
rosdep install -y --from-path src --ignore-src
colcon build
colcon bundleThe preceding block creates the bundle required for running the application in AWS RoboMaker service at simulation_ws/bundle/output.tar location.
Test the application on your local machine by running the following commands:
source install/setup.bash
export TURTLEBOT3_MODEL="waffle_pi"
roslaunch simulation_app mapping_sample_application.launch gui:=true x_pos:=3.5 y_pos:=2.0You see a Turtlebot moving in the gazebo environment building a map! The application is set up to run on a default gazebo environment, and can be switched to WorldForge mode by setting the environment variable GAZEBO_WORLD to WORLDFORGE. Setting the environment variable to WORLDFORGE on the application requires you to export the WORLDFORGE world to your local machine. You can find instructions for exporting the world here.
AWS RoboMaker has first class support for WorldForge worlds so you can connect the application to the WorldForge world directly on AWS RoboMaker which is covered further within this blog. Exit the local simulation here.
Create the Simulation Application in AWS RoboMaker, by uploading the bundle file from your local machine to an Amazon S3 bucket. Export the S3 bucket name in your AWS account to the environment variable BUCKET_NAME on your local machine. Use “sim_app_path” prefix on your Amazon S3 bucket to upload the bundle file.
export BUCKET_NAME=<YOUR_BUCKET_NAME>
export SIM_APP_PREFIX="sim_app_path"Run the following command to copy the bundle file to an Amazon S3 bucket, and then to create the Simulation Application.
aws s3 cp bundle/output.tar s3://$BUCKET_NAME/$SIM_APP_PREFIX/output.tar
aws robomaker create-simulation-application --name my-mapping-app --sources s3Bucket=$BUCKET_NAME,s3Key=$SIM_APP_PREFIX/output.tar,architecture=X86_64 --robot-software-suite name=ROS,version=Melodic --simulation-software-suite name=Gazebo,version=9 --rendering-engine name=OGRE,version=1.xExport the ARN from the response to an environment variable called SIM_APP_ARN. This is also used when creating the batch of simulation jobs.
export SIM_APP_ARN=<SIM_APP_ARN>Running a Batch of Simulations with WorldForge Worlds
By now, you should have a simulation application setup in AWS RobMaker. Create a batch of ten simulation jobs to test the mapping algorithm in ten different WorldForge worlds that were generated. More variety in worlds provides robust testing for algorithms in simulation environments.
Create the configuration file for the batch API using create_batch_params.py script in sample application repository.
Next, create an IAM role to run your AWS RobMaker simulation jobs.
Save the following JSON to a file called trust_policy.json, which will be the role policy associated with the IAM role.
{
"Version": "2012-10-17",
"Statement": [
{
"Effect": "Allow",
"Principal": {
"Service": "robomaker.amazonaws.com"
},
"Action": "sts:AssumeRole"
}
]
}
Run the following commands to create the role.
export IAM_ROLE_NAME=mapping-role
aws iam create-role --role-name $IAM_ROLE_NAME --assume-role-policy-document file://trust_policy.jsonExport the ARN from the output to the environment variable IAM_ROLE_ARN with the following command.
export IAM_ROLE_ARN=<IAM_ROLE_ARN>Attach the managed AWSRoboMaker_Access to the role with the following command. This gives the IAM role permission to act on any AWS RobMaker API.
aws iam attach-role-policy --role $IAM_ROLE_NAME --policy-arn arn:aws:iam::aws:policy/AWSRoboMaker_FullAccessSave the following JSON file to a file called mapping_robomaker_policy.json. Ensure that you have replaced <BUCKET_NAME> with the bucket in the environment variable BUCKET_NAME. This file is used to provide the custom permission the IAM role needs to write logs , access the application bundle and to upload maps to Amazon S3 bucket.
{
"Version": "2012-10-17",
"Statement": [
{
"Sid": "VisualEditor0",
"Effect": "Allow",
"Action": [
"logs:CreateLogStream",
"cloudwatch:PutMetricData",
"logs:DescribeLogStreams",
"logs:CreateLogGroup",
"logs:PutLogEvents"
],
"Resource": "*"
},
{
"Sid": "VisualEditor1",
"Effect": "Allow",
"Action": [
"s3:GetObject",
"s3:PutObject"
],
"Resource": "arn:aws:s3:::<BUCKET_NAME>/*"
}
]
}
Create a custom policy and store the ARNs to environment variables by running the following commands
aws iam create-policy --policy-name mapping-robomaker-policy --policy-document file://mapping_robomaker_policy.jsonExport the ARN to an environment variable referred by S3_POLICY_ARN
export MAPPING_POLICY=<MAPPING_POLICY_ARN>Attach the custom policy with the IAM role with the following command
aws iam attach-role-policy --role $IAM_ROLE_NAME --policy-arn $MAPPING_POLICYYou have everything needed to create the configuration for the batch API. Create the configuration file and start a batch of simulations by running the following commands.
cd ../../aws-robomaker-worldforge-mapping-evaluation-sample-app/setup_scripts
aws robomaker describe-world-generation-job --job $GENERATION_JOB_ARN --output json > generation_job_output.json
#Read world ARN's from 'generation_job_output.json';write config to 'batch_config.json'
python create_batch_params.py
aws robomaker start-simulation-job-batch --cli-input-json file://batch_config.jsonThe simulations are created from this API. Open the Simulation Application tool from the simulation details page by navigating to a simulation job on the AWS RoboMaker console and clicking “Connect” to set the robot navigating and mapping the world.
Once the robot explores the area and creates the map, the map files are saved from the simulations are uploaded to the Amazon S3 location set by a custom upload configuration.
Custom upload configuration:
AWS RoboMaker provides ability to easily upload files from a simulation job using custom upload configuration without requiring any other code setup. In this application the map file follows the name <AWS_ROBOMAKER_SIMULATION_JOB_ID>.pgm, where <AWS_ROBOMAKER_SIMULATION_JOB_ID> is an environment variable created by AWS RoboMaker in its simulation jobs. The filename used in this application is chosen to make it easy to identify the simulation job corresponding to the map. This map file in our application is written to the default location “/home/robomaker” in the simulation job. To enable uploading this file to Amazon S3 location, you have to setup the custom upload configuration in the simulation configuration passed to the CreateSimulationJob API, which in our case is setup up programmatically in this blog. The custom upload configuration in this example results in all files with “.pgm” extension in the corresponding path to be uploaded to the designated S3 location at end of simulation.
"uploadConfigurations": [
{
"name": "map_results",
"path": "/home/robomaker/**.pgm",
"uploadBehavior": "UPLOAD_ON_TERMINATE"
}
]The configuration file containing the JSON for setting up the batch simulation API for our application, including the upload configuration, is created by the create_batch_params.py script, and all the custom parameters used in the ROS application are available in the applications’ launch file.
UPLOAD_ON_TERMINATE behavior uploads all files matching the path once the simulation job enters the terminating state. You can read more about custom upload configuration at documentation here.
You have now completed all tasks. The maps from the simulation are available in Amazon S3 location
s3://<BUCKET_NAME>/<simid>/<runid>/map_results/<simid>.pgm
Shown below is an image with a generated map downloaded from the Amazon S3 bucket.
The image below shows all the map files available in the Amazon S3 bucket.
Summary:
In this blog, we showed you how to create a variety of world’s in AWS RobMaker WorldForge in minutes. We also identified how to run simulations in parallel by connecting a sample application to the generated worlds, and running them concurrently. Then we uploaded the files from simulation using the custom upload configuration capability of AWS RoboMaker. Now, you can test core robotics algorithms with only a couple of API calls!
To learn more about AWS RoboMaker, visit https://thinkwithwp.com/robomaker/ or contact us at aws-robomaker-bd@amazon.com