Upload
others
View
19
Download
0
Embed Size (px)
Citation preview
Amazon Elastic MapReduceAPI Reference
API Version 2009-03-31
Amazon Elastic MapReduce API Reference
Amazon Elastic MapReduce: API ReferenceCopyright © 2020 Amazon Web Services, Inc. and/or its affiliates. All rights reserved.
Amazon's trademarks and trade dress may not be used in connection with any product or service that is notAmazon's, in any manner that is likely to cause confusion among customers, or in any manner that disparages ordiscredits Amazon. All other trademarks not owned by Amazon are the property of their respective owners, who mayor may not be affiliated with, connected to, or sponsored by Amazon.
Amazon Elastic MapReduce API Reference
Table of ContentsWelcome .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1Actions .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
AddInstanceFleet ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
AddInstanceGroups .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8Example .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
AddJobFlowSteps .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11Example .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
AddTags .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14Example .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
CancelSteps .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18Example .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
CreateSecurityConfiguration .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
DeleteSecurityConfiguration .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
DescribeCluster ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
API Version 2009-03-31iii
Amazon Elastic MapReduce API Reference
Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
DescribeJobFlows .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31Example .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
DescribeSecurityConfiguration .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
DescribeStep .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
GetBlockPublicAccessConfiguration .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
GetManagedScalingPolicy .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
ListBootstrapActions .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
ListClusters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
ListInstanceFleets ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
API Version 2009-03-31iv
Amazon Elastic MapReduce API Reference
Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
ListInstanceGroups .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
ListInstances .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
ListSecurityConfigurations .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
ListSteps .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
ModifyCluster ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
ModifyInstanceFleet ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
ModifyInstanceGroups .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67Example .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
PutAutoScalingPolicy .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
API Version 2009-03-31v
Amazon Elastic MapReduce API Reference
Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
PutBlockPublicAccessConfiguration .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74
PutManagedScalingPolicy .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75
RemoveAutoScalingPolicy .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77
RemoveManagedScalingPolicy .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79
RemoveTags .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80Examples .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
RunJobFlow .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88Response Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93Example .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95
SetTerminationProtection .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97Example .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
SetVisibleToAllUsers ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99Example .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100
TerminateJobFlows .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102Request Syntax .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102
API Version 2009-03-31vi
Amazon Elastic MapReduce API Reference
Request Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102Response Elements .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102Example .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103
Data Types .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104Application .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106
Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106
AutoScalingPolicy .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107
AutoScalingPolicyDescription .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108
AutoScalingPolicyStateChangeReason .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109
AutoScalingPolicyStatus .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110
BlockPublicAccessConfiguration .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111
BlockPublicAccessConfigurationMetadata .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112
BootstrapActionConfig .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113
BootstrapActionDetail .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114
CancelStepsInfo .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115
CloudWatchAlarmDefinition .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117
Cluster ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122
ClusterStateChangeReason .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 123Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 123See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 123
ClusterStatus .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124
ClusterSummary .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 125Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 125See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 126
ClusterTimeline .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 127Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 127See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 127
Command .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 128Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 128See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 128
API Version 2009-03-31vii
Amazon Elastic MapReduce API Reference
ComputeLimits ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129
Configuration .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131
EbsBlockDevice .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 132Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 132See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 132
EbsBlockDeviceConfig .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133
EbsConfiguration .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 134Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 134See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 134
EbsVolume .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 135Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 135See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 135
Ec2InstanceAttributes .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 136Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 136See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 137
FailureDetails ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139
HadoopJarStepConfig .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 140Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 140See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 140
HadoopStepConfig .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 142Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 142See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 142
Instance .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 143Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 143See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 144
InstanceFleet ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 145Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 145See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 147
InstanceFleetConfig .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 148Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 148See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 149
InstanceFleetModifyConfig .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 150Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 150See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 150
InstanceFleetProvisioningSpecifications .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 151Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 151See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 151
InstanceFleetStateChangeReason .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 152Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 152See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 152
InstanceFleetStatus .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
InstanceFleetTimeline .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155
InstanceGroup .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 156Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 156See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 158
API Version 2009-03-31viii
Amazon Elastic MapReduce API Reference
InstanceGroupConfig .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160
InstanceGroupDetail .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 161Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 161See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 163
InstanceGroupModifyConfig .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 164Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 164See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 164
InstanceGroupStateChangeReason .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 166Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 166See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 166
InstanceGroupStatus .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 167Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 167See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 167
InstanceGroupTimeline .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 168Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 168See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 168
InstanceResizePolicy .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 169Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 169See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 169
InstanceStateChangeReason .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 170Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 170See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 170
InstanceStatus .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 171Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 171See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 171
InstanceTimeline .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 172Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 172See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 172
InstanceTypeConfig .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 173Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 173See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 174
InstanceTypeSpecification .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 175Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 175See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 176
JobFlowDetail .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 177Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 177See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 179
JobFlowExecutionStatusDetail .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 181Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 181See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 182
JobFlowInstancesConfig .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 183Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 183See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 186
JobFlowInstancesDetail .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 187Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 187See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 189
KerberosAttributes .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 190Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 190See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 191
KeyValue .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 192Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 192See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 192
ManagedScalingPolicy .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 193Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 193See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 193
API Version 2009-03-31ix
Amazon Elastic MapReduce API Reference
MetricDimension .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 194Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 194See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 194
PlacementType .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 195Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 195See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 195
PortRange .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 196Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 196See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 196
ScalingAction .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 197Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 197See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 197
ScalingConstraints ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 198Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 198See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 198
ScalingRule .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 199Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 199See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 199
ScalingTrigger .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 200Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 200See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 200
ScriptBootstrapActionConfig .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 201Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 201See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 201
SecurityConfigurationSummary .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 202Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 202See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 202
ShrinkPolicy .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 203Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 203See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 203
SimpleScalingPolicyConfiguration .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 204Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 204See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 204
SpotProvisioningSpecification .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 206Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 206See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 206
Step .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 208Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 208See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 208
StepConfig .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 210Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 210See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 210
StepDetail .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211
StepExecutionStatusDetail .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 212Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 212See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 212
StepStateChangeReason .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 214Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 214See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 214
StepStatus .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 215Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 215See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 215
StepSummary .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 216Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 216See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 216
API Version 2009-03-31x
Amazon Elastic MapReduce API Reference
StepTimeline .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 218Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 218See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 218
SupportedProductConfig .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 219Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 219See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 219
Tag .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 220Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 220See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 220
VolumeSpecification .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 221Contents .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 221See Also .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 221
Common Parameters ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 222Common Errors ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 224
API Version 2009-03-31xi
Amazon Elastic MapReduce API Reference
WelcomeAmazon EMR is a web service that makes it easy to process large amounts of data efficiently. AmazonEMR uses Hadoop processing combined with several AWS products to do tasks such as web indexing,data mining, log file analysis, machine learning, scientific simulation, and data warehousing.
This document was last published on June 12, 2020.
API Version 2009-03-311
Amazon Elastic MapReduce API Reference
ActionsThe following actions are supported:
• AddInstanceFleet (p. 3)• AddInstanceGroups (p. 6)• AddJobFlowSteps (p. 10)• AddTags (p. 14)• CancelSteps (p. 17)• CreateSecurityConfiguration (p. 21)• DeleteSecurityConfiguration (p. 23)• DescribeCluster (p. 25)• DescribeJobFlows (p. 28)• DescribeSecurityConfiguration (p. 34)• DescribeStep (p. 36)• GetBlockPublicAccessConfiguration (p. 38)• GetManagedScalingPolicy (p. 40)• ListBootstrapActions (p. 42)• ListClusters (p. 44)• ListInstanceFleets (p. 47)• ListInstanceGroups (p. 50)• ListInstances (p. 54)• ListSecurityConfigurations (p. 57)• ListSteps (p. 59)• ModifyCluster (p. 62)• ModifyInstanceFleet (p. 64)• ModifyInstanceGroups (p. 66)• PutAutoScalingPolicy (p. 69)• PutBlockPublicAccessConfiguration (p. 73)• PutManagedScalingPolicy (p. 75)• RemoveAutoScalingPolicy (p. 77)• RemoveManagedScalingPolicy (p. 79)• RemoveTags (p. 80)• RunJobFlow (p. 84)• SetTerminationProtection (p. 96)• SetVisibleToAllUsers (p. 99)• TerminateJobFlows (p. 102)
API Version 2009-03-312
Amazon Elastic MapReduce API ReferenceAddInstanceFleet
AddInstanceFleetAdds an instance fleet to a running cluster.
NoteThe instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x.
Request Syntax
{ "ClusterId": "string", "InstanceFleet": { "InstanceFleetType": "string", "InstanceTypeConfigs": [ { "BidPrice": "string", "BidPriceAsPercentageOfOnDemandPrice": number, "Configurations": [ { "Classification": "string", "Configurations": [ "Configuration" ], "Properties": { "string" : "string" } } ], "EbsConfiguration": { "EbsBlockDeviceConfigs": [ { "VolumeSpecification": { "Iops": number, "SizeInGB": number, "VolumeType": "string" }, "VolumesPerInstance": number } ], "EbsOptimized": boolean }, "InstanceType": "string", "WeightedCapacity": number } ], "LaunchSpecifications": { "SpotSpecification": { "BlockDurationMinutes": number, "TimeoutAction": "string", "TimeoutDurationMinutes": number } }, "Name": "string", "TargetOnDemandCapacity": number, "TargetSpotCapacity": number }}
API Version 2009-03-313
Amazon Elastic MapReduce API ReferenceRequest Parameters
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ClusterId (p. 3)
The unique identifier of the cluster.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: YesInstanceFleet (p. 3)
Specifies the configuration of the instance fleet.
Type: InstanceFleetConfig (p. 148) object
Required: Yes
Response Syntax{ "ClusterArn": "string", "ClusterId": "string", "InstanceFleetId": "string"}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
ClusterArn (p. 4)
The Amazon Resource Name of the cluster.
Type: String
Length Constraints: Minimum length of 20. Maximum length of 2048.ClusterId (p. 4)
The unique identifier of the cluster.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
API Version 2009-03-314
Amazon Elastic MapReduce API ReferenceErrors
InstanceFleetId (p. 4)
The unique identifier of the instance fleet.
Type: String
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-315
Amazon Elastic MapReduce API ReferenceAddInstanceGroups
AddInstanceGroupsAdds one or more instance groups to a running cluster.
Request Syntax{ "InstanceGroups": [ { "AutoScalingPolicy": { "Constraints": { "MaxCapacity": number, "MinCapacity": number }, "Rules": [ { "Action": { "Market": "string", "SimpleScalingPolicyConfiguration": { "AdjustmentType": "string", "CoolDown": number, "ScalingAdjustment": number } }, "Description": "string", "Name": "string", "Trigger": { "CloudWatchAlarmDefinition": { "ComparisonOperator": "string", "Dimensions": [ { "Key": "string", "Value": "string" } ], "EvaluationPeriods": number, "MetricName": "string", "Namespace": "string", "Period": number, "Statistic": "string", "Threshold": number, "Unit": "string" } } } ] }, "BidPrice": "string", "Configurations": [ { "Classification": "string", "Configurations": [ "Configuration" ], "Properties": { "string" : "string" } } ], "EbsConfiguration": { "EbsBlockDeviceConfigs": [ { "VolumeSpecification": {
API Version 2009-03-316
Amazon Elastic MapReduce API ReferenceRequest Parameters
"Iops": number, "SizeInGB": number, "VolumeType": "string" }, "VolumesPerInstance": number } ], "EbsOptimized": boolean }, "InstanceCount": number, "InstanceRole": "string", "InstanceType": "string", "Market": "string", "Name": "string" } ], "JobFlowId": "string"}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
InstanceGroups (p. 6)
Instance groups to add.
Type: Array of InstanceGroupConfig (p. 159) objects
Required: YesJobFlowId (p. 6)
Job flow in which to add the instance groups.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: Yes
Response Syntax{ "ClusterArn": "string", "InstanceGroupIds": [ "string" ], "JobFlowId": "string"}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
API Version 2009-03-317
Amazon Elastic MapReduce API ReferenceErrors
ClusterArn (p. 7)
The Amazon Resource Name of the cluster.
Type: String
Length Constraints: Minimum length of 20. Maximum length of 2048.InstanceGroupIds (p. 7)
Instance group IDs of the newly created instance groups.
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*JobFlowId (p. 7)
The job flow ID in which the instance groups are added.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerError
Indicates that an error occurred while processing the request and that the request was notcompleted.
HTTP Status Code: 400
Example
Sample Request
POST / HTTP/1.1Content-Type: application/x-amz-json-1.1X-Amz-Target: ElasticMapReduce.AddInstanceGroupsContent-Length: 168User-Agent: aws-sdk-ruby/1.9.2 ruby/1.9.3 i386-mingw32Host: us-east-1.elasticmapreduce.amazonaws.comX-Amz-Date: 20130715T223346ZX-Amz-Content-Sha256: ac5a7193b1283898dd822a4b16ca36963879bb010d2dbe57198439973ab2a7d3Authorization: AWS4-HMAC-SHA256 Credential=AKIAIOSFODNN7EXAMPLE/20130715/us-east-1/elasticmapreduce/aws4_request, SignedHeaders=content-length;content-type;host;user-agent;x-amz-content-sha256;x-amz-date;x-amz-target, Signature=4c5e7eb762ea45f292a5cd1a1cc56ed60009e19a9dba3d6e5e4e67e96d43af11Accept: */*
{
API Version 2009-03-318
Amazon Elastic MapReduce API ReferenceSee Also
"JobFlowId": "j-3U7TSX5GZFD8Y", "InstanceGroups": [{ "Name": "Task Instance Group", "InstanceRole": "TASK", "InstanceCount": 2, "InstanceType": "m1.small", "Market": "ON_DEMAND" }]}
Sample Response
HTTP/1.1 200 OKx-amzn-RequestId: 9da5a349-ed9e-11e2-90db-69a5154aeb8dContent-Type: application/x-amz-json-1.1Content-Length: 71Date: Mon, 15 Jul 2013 22:33:47 GMT
{ "InstanceGroupIds": ["ig-294A6A2KWT4WB"], "JobFlowId": "j-3U7TSX5GZFD8Y"}
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-319
Amazon Elastic MapReduce API ReferenceAddJobFlowSteps
AddJobFlowStepsAddJobFlowSteps adds new steps to a running cluster. A maximum of 256 steps are allowed in each jobflow.
If your cluster is long-running (such as a Hive data warehouse) or complex, you may require more than256 steps to process your data. You can bypass the 256-step limitation in various ways, including usingSSH to connect to the master node and submitting queries directly to the software running on themaster node, such as Hive and Hadoop. For more information on how to do this, see Add More than 256Steps to a Cluster in the Amazon EMR Management Guide.
A step specifies the location of a JAR file stored either on the master node of the cluster or in AmazonS3. Each step is performed by the main function of the main class of the JAR file. The main class can bespecified either in the manifest of the JAR or by using the MainFunction parameter of the step.
Amazon EMR executes each step in the order listed. For a step to be considered complete, the mainfunction must exit with a zero exit code and all Hadoop jobs started while the step was running musthave completed and run successfully.
You can only add steps to a cluster that is in one of the following states: STARTING, BOOTSTRAPPING,RUNNING, or WAITING.
Request Syntax{ "JobFlowId": "string", "Steps": [ { "ActionOnFailure": "string", "HadoopJarStep": { "Args": [ "string" ], "Jar": "string", "MainClass": "string", "Properties": [ { "Key": "string", "Value": "string" } ] }, "Name": "string" } ]}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
JobFlowId (p. 10)
A string that uniquely identifies the job flow. This identifier is returned by RunJobFlow (p. 84) andcan also be obtained from ListClusters (p. 44).
Type: String
API Version 2009-03-3110
Amazon Elastic MapReduce API ReferenceResponse Syntax
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: YesSteps (p. 10)
A list of StepConfig (p. 210) to be executed by the job flow.
Type: Array of StepConfig (p. 210) objects
Required: Yes
Response Syntax{ "StepIds": [ "string" ]}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
StepIds (p. 11)
The identifiers of the list of steps added to the job flow.
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerError
Indicates that an error occurred while processing the request and that the request was notcompleted.
HTTP Status Code: 400
Example
Sample Request
POST / HTTP/1.1Content-Type: application/x-amz-json-1.1X-Amz-Target: ElasticMapReduce.AddJobFlowSteps
API Version 2009-03-3111
Amazon Elastic MapReduce API ReferenceSee Also
Content-Length: 426User-Agent: aws-sdk-ruby/1.9.2 ruby/1.9.3 i386-mingw32Host: us-east-1.elasticmapreduce.amazonaws.comX-Amz-Date: 20130716T210948ZX-Amz-Content-Sha256: 9e5ad0a93c22224947ce98eea94f766103d91b28fa82eb60d0cb8b6f9555a6b2Authorization: AWS4-HMAC-SHA256 Credential=AKIAIOSFODNN7EXAMPLE/20130716/us-east-1/elasticmapreduce/aws4_request, SignedHeaders=content-length;content-type;host;user-agent;x-amz-content-sha256;x-amz-date;x-amz-target, Signature=2a2393390760ae85eb74ee3a539e1d758bfdd8815a1a6d6f14d4a2fbcfdcd5b7Accept: */*
{ "JobFlowId": "j-3TS0OIYO4NFN", "Steps": [{ "Name": "Example Jar Step", "ActionOnFailure": "CANCEL_AND_WAIT", "HadoopJarStep": { "Jar": "s3n:\\/\\/elasticmapreduce\\/samples\\/cloudburst\\/cloudburst.jar", "Args": [ "s3n:\\/\\/elasticmapreduce\\/samples\\/cloudburst\\/input\\/s_suis.br", "s3n:\\/\\/elasticmapreduce\\/samples\\/cloudburst\\/input\\/100k.br", "s3n:\\/\\/examples-bucket\\/cloudburst\\/output", "36", "3", "0", "1", "240", "48", "24", "24", "128", "16" ] } }]}
Sample Response
HTTP/1.1 200 OKx-amzn-RequestId: 6514261f-ee5b-11e2-9345-5332e9ab2e6dContent-Type: application/x-amz-json-1.1Content-Length: 0Date: Tue, 16 Jul 2013 21:05:07 GMT
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python
API Version 2009-03-3112
Amazon Elastic MapReduce API ReferenceSee Also
• AWS SDK for Ruby V3
API Version 2009-03-3113
Amazon Elastic MapReduce API ReferenceAddTags
AddTagsAdds tags to an Amazon EMR resource. Tags make it easier to associate clusters in various ways, such asgrouping clusters to track your Amazon EMR resource allocation costs. For more information, see TagClusters.
Request Syntax{ "ResourceId": "string", "Tags": [ { "Key": "string", "Value": "string" } ]}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ResourceId (p. 14)
The Amazon EMR resource identifier to which tags will be added. This value must be a clusteridentifier.
Type: String
Required: YesTags (p. 14)
A list of tags to associate with a cluster and propagate to EC2 instances. Tags are user-defined key/value pairs that consist of a required key string with a maximum of 128 characters, and an optionalvalue string with a maximum of 256 characters.
Type: Array of Tag (p. 220) objects
Required: Yes
Response ElementsIf the action is successful, the service sends back an HTTP 200 response with an empty HTTP body.
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500
API Version 2009-03-3114
Amazon Elastic MapReduce API ReferenceExample
InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
Example
Sample Request
POST / HTTP/1.1 Content-Type: application/x-amz-json-1.1 X-Amz-Target: ElasticMapReduce.AddTags AUTHPARAMS { "ResourceId": "j-3U7TSX5GZFD8Y", "Tags": [{ "Key": "stack", "Value": "Production" }, { "Key": "hbase" }] }
Sample Response
HTTP/1.1 200 OK x-amzn-RequestId: 9da5a349-ed9e-11e2-90db-69a5154aeb8d Content-Type: application/x-amz-json-1.1
API Version 2009-03-3115
Amazon Elastic MapReduce API ReferenceSee Also
Content-Length: 71 Date: Mon, 15 Jul 2013 22:33:47 GMT { }
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3116
Amazon Elastic MapReduce API ReferenceCancelSteps
CancelStepsCancels a pending step or steps in a running cluster. Available only in Amazon EMR versions 4.8.0and later, excluding version 5.0.0. A maximum of 256 steps are allowed in each CancelSteps request.CancelSteps is idempotent but asynchronous; it does not guarantee a step will be canceled, even if therequest is successfully submitted. You can only cancel steps that are in a PENDING state.
Request Syntax{ "ClusterId": "string", "StepCancellationOption": "string", "StepIds": [ "string" ]}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ClusterId (p. 17)
The ClusterID for which specified steps will be canceled. Use RunJobFlow (p. 84) andListClusters (p. 44) to get ClusterIDs.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: Yes
StepCancellationOption (p. 17)
The option to choose for cancelling RUNNING steps. By default, the value is SEND_INTERRUPT.
Type: String
Valid Values: SEND_INTERRUPT | TERMINATE_PROCESS
Required: No
StepIds (p. 17)
The list of StepIDs to cancel. Use ListSteps (p. 59) to get steps and their states for the specifiedcluster.
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: Yes
API Version 2009-03-3117
Amazon Elastic MapReduce API ReferenceResponse Syntax
Response Syntax{ "CancelStepsInfoList": [ { "Reason": "string", "Status": "string", "StepId": "string" } ]}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
CancelStepsInfoList (p. 18)
A list of CancelStepsInfo (p. 115), which shows the status of specified cancel requests for eachStepID specified.
Type: Array of CancelStepsInfo (p. 115) objects
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerError
Indicates that an error occurred while processing the request and that the request was notcompleted.
HTTP Status Code: 400InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
Example
Sample Request
POST / HTTP/1.1Content-Type: application/x-amz-json-1.1X-Amz-Target: ElasticMapReduce.CancelStepsUser-Agent: aws-sdk-ruby/1.9.2 ruby/1.9.3 i386-mingw32Host: us-east-1.elasticmapreduce.amazonaws.comX-Amz-Date: 20160719T224800ZX-Amz-Content-Sha256: 9e5ad0a93c22224947ce98eea94f766103d91b28fa82eb60d0cb8b6f9555a6b2Authorization: AWS4-HMAC-SHA256 Credential=AKIAIOSFODNN7EXAMPLE/20160719/us-east-1/elasticmapreduce/aws4_request, SignedHeaders=content-length;content-
API Version 2009-03-3118
Amazon Elastic MapReduce API ReferenceSee Also
type;host;user-agent;x-amz-content-sha256;x-amz-date;x-amz-target, Signature=2a2393390760ae85eb74ee3a539e1d758bfdd8815a1a6d6f14d4a2fbcfdcd5b7Accept: */*
{ "ClusterId": "j-2G7RS6DJZE39D", "StepIds": [ "s-11B5G7VIKHCZQ", "s-23PUT0NR3XF6O", "s-2NUYMUZ3ADACC", "s-10O5XO5JUY9OE", "s-CS88G2XK4N7X", "s-2M366D3KU4OTZ" ]}
Sample Response
HTTP/1.1 200 OKx-amzn-RequestId: 84931a23-4e03-11e6-b2bd-0db72d19890aContent-Type: application/x-amz-json-1.1Date: Tue, 19 Jul 2016 15:31:01 GMT
{ "CancelStepsInfoList": [ {"Reason": "This step cannot be cancelled.", "Status": "FAILED", "StepId": "s-11B5G7VIKHCZQ"}, {"Reason": "Cannot cancel the step. It is already COMPLETED.", "Status": "FAILED", "StepId": "s-23PUT0NR3XF6O"}, {"Reason": "Cannot cancel the step. It is already CANCELLED.", "Status": "FAILED", "StepId": "s-2NUYMUZ3ADACC"}, {"Reason": "Cannot cancel the step. It is already RUNNING.", "Status": "FAILED", "StepId": "s-10O5XO5JUY9OE"}, {"Reason": "Cannot cancel the step. It is already FAILED.", "Status": "FAILED", "StepId": "s-CS88G2XK4N7X"}, {"Reason": "", "Status": "SUBMITTED", "StepId": "s-2M366D3KU4OTZ"} ]}
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3119
Amazon Elastic MapReduce API ReferenceSee Also
API Version 2009-03-3120
Amazon Elastic MapReduce API ReferenceCreateSecurityConfiguration
CreateSecurityConfigurationCreates a security configuration, which is stored in the service and can be specified when a cluster iscreated.
Request Syntax{ "Name": "string", "SecurityConfiguration": "string"}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
Name (p. 21)
The name of the security configuration.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: YesSecurityConfiguration (p. 21)
The security configuration details in JSON format. For JSON parameters and examples, see UseSecurity Configurations to Set Up Cluster Security in the Amazon EMR Management Guide.
Type: String
Required: Yes
Response Syntax{ "CreationDateTime": number, "Name": "string"}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
CreationDateTime (p. 21)
The date and time the security configuration was created.
API Version 2009-03-3121
Amazon Elastic MapReduce API ReferenceErrors
Type: TimestampName (p. 21)
The name of the security configuration.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3122
Amazon Elastic MapReduce API ReferenceDeleteSecurityConfiguration
DeleteSecurityConfigurationDeletes a security configuration.
Request Syntax{ "Name": "string"}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
Name (p. 23)
The name of the security configuration.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: Yes
Response ElementsIf the action is successful, the service sends back an HTTP 200 response with an empty HTTP body.
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface
API Version 2009-03-3123
Amazon Elastic MapReduce API ReferenceSee Also
• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3124
Amazon Elastic MapReduce API ReferenceDescribeCluster
DescribeClusterProvides cluster-level details including status, hardware and software configuration, VPC settings, and soon.
For information about the cluster steps, see ListSteps (p. 59).
Request Syntax{ "ClusterId": "string"}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ClusterId (p. 25)
The identifier of the cluster to describe.
Type: String
Required: Yes
Response Syntax{ "Cluster": { "Applications": [ { "AdditionalInfo": { "string" : "string" }, "Args": [ "string" ], "Name": "string", "Version": "string" } ], "AutoScalingRole": "string", "AutoTerminate": boolean, "ClusterArn": "string", "Configurations": [ { "Classification": "string", "Configurations": [ "Configuration" ], "Properties": { "string" : "string" } } ],
API Version 2009-03-3125
Amazon Elastic MapReduce API ReferenceResponse Elements
"CustomAmiId": "string", "EbsRootVolumeSize": number, "Ec2InstanceAttributes": { "AdditionalMasterSecurityGroups": [ "string" ], "AdditionalSlaveSecurityGroups": [ "string" ], "Ec2AvailabilityZone": "string", "Ec2KeyName": "string", "Ec2SubnetId": "string", "EmrManagedMasterSecurityGroup": "string", "EmrManagedSlaveSecurityGroup": "string", "IamInstanceProfile": "string", "RequestedEc2AvailabilityZones": [ "string" ], "RequestedEc2SubnetIds": [ "string" ], "ServiceAccessSecurityGroup": "string" }, "Id": "string", "InstanceCollectionType": "string", "KerberosAttributes": { "ADDomainJoinPassword": "string", "ADDomainJoinUser": "string", "CrossRealmTrustPrincipalPassword": "string", "KdcAdminPassword": "string", "Realm": "string" }, "LogEncryptionKmsKeyId": "string", "LogUri": "string", "MasterPublicDnsName": "string", "Name": "string", "NormalizedInstanceHours": number, "OutpostArn": "string", "ReleaseLabel": "string", "RepoUpgradeOnBoot": "string", "RequestedAmiVersion": "string", "RunningAmiVersion": "string", "ScaleDownBehavior": "string", "SecurityConfiguration": "string", "ServiceRole": "string", "Status": { "State": "string", "StateChangeReason": { "Code": "string", "Message": "string" }, "Timeline": { "CreationDateTime": number, "EndDateTime": number, "ReadyDateTime": number } }, "StepConcurrencyLevel": number, "Tags": [ { "Key": "string", "Value": "string" } ], "TerminationProtected": boolean, "VisibleToAllUsers": boolean }}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
API Version 2009-03-3126
Amazon Elastic MapReduce API ReferenceErrors
The following data is returned in JSON format by the service.
Cluster (p. 25)
This output contains the details for the requested cluster.
Type: Cluster (p. 118) object
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3127
Amazon Elastic MapReduce API ReferenceDescribeJobFlows
DescribeJobFlowsThis API is deprecated and will eventually be removed. We recommend you useListClusters (p. 44), DescribeCluster (p. 25), ListSteps (p. 59), ListInstanceGroups (p. 50) andListBootstrapActions (p. 42) instead.
DescribeJobFlows returns a list of job flows that match all of the supplied parameters. The parameterscan include a list of job flow IDs, job flow states, and restrictions on job flow creation date and time.
Regardless of supplied parameters, only job flows created within the last two months are returned.
If no parameters are supplied, then job flows matching either of the following criteria are returned:
• Job flows created and completed in the last two weeks• Job flows created within the last two months that are in one of the following states: RUNNING,WAITING, SHUTTING_DOWN, STARTING
Amazon EMR can return a maximum of 512 job flow descriptions.
Request Syntax{ "CreatedAfter": number, "CreatedBefore": number, "JobFlowIds": [ "string" ], "JobFlowStates": [ "string" ]}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
CreatedAfter (p. 28)
Return only job flows created after this date and time.
Type: Timestamp
Required: NoCreatedBefore (p. 28)
Return only job flows created before this date and time.
Type: Timestamp
Required: NoJobFlowIds (p. 28)
Return only job flows whose job flow ID is contained in this list.
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 10280.
API Version 2009-03-3128
Amazon Elastic MapReduce API ReferenceResponse Syntax
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoJobFlowStates (p. 28)
Return only job flows whose state is contained in this list.
Type: Array of strings
Valid Values: STARTING | BOOTSTRAPPING | RUNNING | WAITING | SHUTTING_DOWN |TERMINATED | COMPLETED | FAILED
Required: No
Response Syntax{ "JobFlows": [ { "AmiVersion": "string", "AutoScalingRole": "string", "BootstrapActions": [ { "BootstrapActionConfig": { "Name": "string", "ScriptBootstrapAction": { "Args": [ "string" ], "Path": "string" } } } ], "ExecutionStatusDetail": { "CreationDateTime": number, "EndDateTime": number, "LastStateChangeReason": "string", "ReadyDateTime": number, "StartDateTime": number, "State": "string" }, "Instances": { "Ec2KeyName": "string", "Ec2SubnetId": "string", "HadoopVersion": "string", "InstanceCount": number, "InstanceGroups": [ { "BidPrice": "string", "CreationDateTime": number, "EndDateTime": number, "InstanceGroupId": "string", "InstanceRequestCount": number, "InstanceRole": "string", "InstanceRunningCount": number, "InstanceType": "string", "LastStateChangeReason": "string", "Market": "string", "Name": "string", "ReadyDateTime": number, "StartDateTime": number, "State": "string" }
API Version 2009-03-3129
Amazon Elastic MapReduce API ReferenceResponse Elements
], "KeepJobFlowAliveWhenNoSteps": boolean, "MasterInstanceId": "string", "MasterInstanceType": "string", "MasterPublicDnsName": "string", "NormalizedInstanceHours": number, "Placement": { "AvailabilityZone": "string", "AvailabilityZones": [ "string" ] }, "SlaveInstanceType": "string", "TerminationProtected": boolean }, "JobFlowId": "string", "JobFlowRole": "string", "LogEncryptionKmsKeyId": "string", "LogUri": "string", "Name": "string", "ScaleDownBehavior": "string", "ServiceRole": "string", "Steps": [ { "ExecutionStatusDetail": { "CreationDateTime": number, "EndDateTime": number, "LastStateChangeReason": "string", "StartDateTime": number, "State": "string" }, "StepConfig": { "ActionOnFailure": "string", "HadoopJarStep": { "Args": [ "string" ], "Jar": "string", "MainClass": "string", "Properties": [ { "Key": "string", "Value": "string" } ] }, "Name": "string" } } ], "SupportedProducts": [ "string" ], "VisibleToAllUsers": boolean } ]}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
JobFlows (p. 29)
A list of job flows matching the parameters supplied.
Type: Array of JobFlowDetail (p. 177) objects
API Version 2009-03-3130
Amazon Elastic MapReduce API ReferenceErrors
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerError
Indicates that an error occurred while processing the request and that the request was notcompleted.
HTTP Status Code: 400
Example
Sample Request
POST / HTTP/1.1Content-Type: application/x-amz-json-1.1X-Amz-Target: ElasticMapReduce.DescribeJobFlowsContent-Length: 62User-Agent: aws-sdk-ruby/1.9.2 ruby/1.9.3 i386-mingw32Host: us-east-1.elasticmapreduce.amazonaws.comX-Amz-Date: 20130715T220330ZX-Amz-Content-Sha256: fce83af973f96f173512aca2845c56862b946feb1de0600326f1365b658a0e39Authorization: AWS4-HMAC-SHA256 Credential=AKIAIOSFODNN7EXAMPLE/20130715/us-east-1/elasticmapreduce/aws4_request, SignedHeaders=content-length;content-type;host;user-agent;x-amz-content-sha256;x-amz-date;x-amz-target, Signature=29F98a6f44e05ad54fe1e8b3d1a7101ab08dc3ad348995f89c533693cee2bb3bAccept: */*
{ "JobFlowIds": ["j-ZKIY4CKQRX72"], "DescriptionType": "EXTENDED"}
Sample Response
HTTP/1.1 200 OKx-amzn-RequestId: 634d4142-ed9a-11e2-bbba-b56d7d016ec4Content-Type: application/x-amz-json-1.1Content-Length: 1624Date: Mon, 15 Jul 2013 22:03:31 GMT
{"JobFlows": [{ "AmiVersion": "2.3.6", "BootstrapActions": [], "ExecutionStatusDetail": { "CreationDateTime": 1.373923429E9, "EndDateTime": 1.373923995E9, "LastStateChangeReason": "Steps completed", "ReadyDateTime": 1.373923754E9, "StartDateTime": 1.373923754E9, "State": "COMPLETED" }, "Instances": { "HadoopVersion": "1.0.3", "InstanceCount": 1, "InstanceGroups": [{ "CreationDateTime": 1.373923429E9, "EndDateTime": 1.373923995E9,
API Version 2009-03-3131
Amazon Elastic MapReduce API ReferenceSee Also
"InstanceGroupId": "ig-3SRUWV3E0NB7K", "InstanceRequestCount": 1, "InstanceRole": "MASTER", "InstanceRunningCount": 0, "InstanceType": "m1.small", "LastStateChangeReason": "Job flow terminated", "Market": "ON_DEMAND", "Name": "Master InstanceGroup", "ReadyDateTime": 1.37392375E9, "StartDateTime": 1.373923646E9, "State": "ENDED" }], "KeepJobFlowAliveWhenNoSteps": false, "MasterInstanceId": "i-8c4fbbef", "MasterInstanceType": "m1.small", "MasterPublicDnsName": "ec2-107-20-46-140.compute-1.amazonaws.com", "NormalizedInstanceHours": 1, "Placement": {"AvailabilityZone": "us-east-1a"}, "TerminationProtected": false }, "JobFlowId": "j-ZKIY4CKQRX72", "Name": "Development Job Flow", "Steps": [{ "ExecutionStatusDetail": { "CreationDateTime": 1.373923429E9, "EndDateTime": 1.373923914E9, "StartDateTime": 1.373923754E9, "State": "COMPLETED" }, "StepConfig": { "ActionOnFailure": "CANCEL_AND_WAIT", "HadoopJarStep": { "Args": [ "-input", "s3://elasticmapreduce/samples/wordcount/input", "-output", "s3://examples-bucket/example-output", "-mapper", "s3://elasticmapreduce/samples/wordcount/wordSplitter.py", "-reducer", "aggregate" ], "Jar": "/home/hadoop/contrib/streaming/hadoop-streaming.jar", "Properties": [] }, "Name": "Example Streaming Step" } }], "SupportedProducts": []}]}
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface
• AWS SDK for .NET
• AWS SDK for C++
• AWS SDK for Go
• AWS SDK for Java
• AWS SDK for JavaScript
API Version 2009-03-3132
Amazon Elastic MapReduce API ReferenceSee Also
• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3133
Amazon Elastic MapReduce API ReferenceDescribeSecurityConfiguration
DescribeSecurityConfigurationProvides the details of a security configuration by returning the configuration JSON.
Request Syntax{ "Name": "string"}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
Name (p. 34)
The name of the security configuration.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: Yes
Response Syntax{ "CreationDateTime": number, "Name": "string", "SecurityConfiguration": "string"}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
CreationDateTime (p. 34)
The date and time the security configuration was created
Type: TimestampName (p. 34)
The name of the security configuration.
Type: String
API Version 2009-03-3134
Amazon Elastic MapReduce API ReferenceErrors
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*SecurityConfiguration (p. 34)
The security configuration details in JSON format.
Type: String
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3135
Amazon Elastic MapReduce API ReferenceDescribeStep
DescribeStepProvides more detail about the cluster step.
Request Syntax{ "ClusterId": "string", "StepId": "string"}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ClusterId (p. 36)
The identifier of the cluster with steps to describe.
Type: String
Required: YesStepId (p. 36)
The identifier of the step to describe.
Type: String
Required: Yes
Response Syntax{ "Step": { "ActionOnFailure": "string", "Config": { "Args": [ "string" ], "Jar": "string", "MainClass": "string", "Properties": { "string" : "string" } }, "Id": "string", "Name": "string", "Status": { "FailureDetails": { "LogFile": "string", "Message": "string", "Reason": "string" }, "State": "string", "StateChangeReason": {
API Version 2009-03-3136
Amazon Elastic MapReduce API ReferenceResponse Elements
"Code": "string", "Message": "string" }, "Timeline": { "CreationDateTime": number, "EndDateTime": number, "StartDateTime": number } } }}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
Step (p. 36)
The step details for the requested step identifier.
Type: Step (p. 208) object
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3137
Amazon Elastic MapReduce API ReferenceGetBlockPublicAccessConfiguration
GetBlockPublicAccessConfigurationReturns the Amazon EMR block public access configuration for your AWS account in the currentRegion. For more information see Configure Block Public Access for Amazon EMR in the Amazon EMRManagement Guide.
Response Syntax{ "BlockPublicAccessConfiguration": { "BlockPublicSecurityGroupRules": boolean, "PermittedPublicSecurityGroupRuleRanges": [ { "MaxRange": number, "MinRange": number } ] }, "BlockPublicAccessConfigurationMetadata": { "CreatedByArn": "string", "CreationDateTime": number }}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
BlockPublicAccessConfiguration (p. 38)
A configuration for Amazon EMR block public access. The configuration applies to all clusterscreated in your account for the current Region. The configuration specifies whether block publicaccess is enabled. If block public access is enabled, security groups associated with the clustercannot have rules that allow inbound traffic from 0.0.0.0/0 or ::/0 on a port, unless the portis specified as an exception using PermittedPublicSecurityGroupRuleRanges in theBlockPublicAccessConfiguration. By default, Port 22 (SSH) is an exception, and public accessis allowed on this port. You can change this by updating the block public access configuration toremove the exception.
NoteFor accounts that created clusters in a Region before November 25, 2019, block publicaccess is disabled by default in that Region. To use this feature, you must manually enableand configure it. For accounts that did not create an EMR cluster in a Region before thisdate, block public access is enabled by default in that Region.
Type: BlockPublicAccessConfiguration (p. 111) object
BlockPublicAccessConfigurationMetadata (p. 38)
Properties that describe the AWS principal that created the BlockPublicAccessConfigurationusing the PutBlockPublicAccessConfiguration action as well as the date and time that theconfiguration was created. Each time a configuration for block public access is updated, AmazonEMR updates this metadata.
Type: BlockPublicAccessConfigurationMetadata (p. 112) object
API Version 2009-03-3138
Amazon Elastic MapReduce API ReferenceErrors
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3139
Amazon Elastic MapReduce API ReferenceGetManagedScalingPolicy
GetManagedScalingPolicyFetches the attached managed scaling policy for an Amazon EMR cluster.
Request Syntax{ "ClusterId": "string"}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ClusterId (p. 40)
Specifies the ID of the cluster for which the managed scaling policy will be fetched.
Type: String
Required: Yes
Response Syntax{ "ManagedScalingPolicy": { "ComputeLimits": { "MaximumCapacityUnits": number, "MaximumOnDemandCapacityUnits": number, "MinimumCapacityUnits": number, "UnitType": "string" } }}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
ManagedScalingPolicy (p. 40)
Specifies the managed scaling policy that is attached to an Amazon EMR cluster.
Type: ManagedScalingPolicy (p. 193) object
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
API Version 2009-03-3140
Amazon Elastic MapReduce API ReferenceSee Also
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3141
Amazon Elastic MapReduce API ReferenceListBootstrapActions
ListBootstrapActionsProvides information about the bootstrap actions associated with a cluster.
Request Syntax{ "ClusterId": "string", "Marker": "string"}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ClusterId (p. 42)
The cluster identifier for the bootstrap actions to list.
Type: String
Required: YesMarker (p. 42)
The pagination token that indicates the next set of results to retrieve.
Type: String
Required: No
Response Syntax{ "BootstrapActions": [ { "Args": [ "string" ], "Name": "string", "ScriptPath": "string" } ], "Marker": "string"}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
BootstrapActions (p. 42)
The bootstrap actions associated with the cluster.
API Version 2009-03-3142
Amazon Elastic MapReduce API ReferenceErrors
Type: Array of Command (p. 128) objectsMarker (p. 42)
The pagination token that indicates the next set of results to retrieve.
Type: String
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3143
Amazon Elastic MapReduce API ReferenceListClusters
ListClustersProvides the status of all clusters visible to this AWS account. Allows you to filter the list of clustersbased on certain criteria; for example, filtering by cluster creation date and time or by status. This callreturns a maximum of 50 clusters per call, but returns a marker to track the paging of the cluster listacross multiple ListClusters calls.
Request Syntax
{ "ClusterStates": [ "string" ], "CreatedAfter": number, "CreatedBefore": number, "Marker": "string"}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ClusterStates (p. 44)
The cluster state filters to apply when listing clusters.
Type: Array of strings
Valid Values: STARTING | BOOTSTRAPPING | RUNNING | WAITING | TERMINATING |TERMINATED | TERMINATED_WITH_ERRORS
Required: No
CreatedAfter (p. 44)
The creation date and time beginning value filter for listing clusters.
Type: Timestamp
Required: No
CreatedBefore (p. 44)
The creation date and time end value filter for listing clusters.
Type: Timestamp
Required: No
Marker (p. 44)
The pagination token that indicates the next set of results to retrieve.
Type: String
Required: No
API Version 2009-03-3144
Amazon Elastic MapReduce API ReferenceResponse Syntax
Response Syntax{ "Clusters": [ { "ClusterArn": "string", "Id": "string", "Name": "string", "NormalizedInstanceHours": number, "OutpostArn": "string", "Status": { "State": "string", "StateChangeReason": { "Code": "string", "Message": "string" }, "Timeline": { "CreationDateTime": number, "EndDateTime": number, "ReadyDateTime": number } } } ], "Marker": "string"}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
Clusters (p. 45)
The list of clusters for the account based on the given filters.
Type: Array of ClusterSummary (p. 125) objectsMarker (p. 45)
The pagination token that indicates the next set of results to retrieve.
Type: String
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
API Version 2009-03-3145
Amazon Elastic MapReduce API ReferenceSee Also
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3146
Amazon Elastic MapReduce API ReferenceListInstanceFleets
ListInstanceFleetsLists all available details about the instance fleets in a cluster.
NoteThe instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x versions.
Request Syntax{ "ClusterId": "string", "Marker": "string"}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ClusterId (p. 47)
The unique identifier of the cluster.
Type: String
Required: YesMarker (p. 47)
The pagination token that indicates the next set of results to retrieve.
Type: String
Required: No
Response Syntax{ "InstanceFleets": [ { "Id": "string", "InstanceFleetType": "string", "InstanceTypeSpecifications": [ { "BidPrice": "string", "BidPriceAsPercentageOfOnDemandPrice": number, "Configurations": [ { "Classification": "string", "Configurations": [ "Configuration" ], "Properties": { "string" : "string"
API Version 2009-03-3147
Amazon Elastic MapReduce API ReferenceResponse Elements
} } ], "EbsBlockDevices": [ { "Device": "string", "VolumeSpecification": { "Iops": number, "SizeInGB": number, "VolumeType": "string" } } ], "EbsOptimized": boolean, "InstanceType": "string", "WeightedCapacity": number } ], "LaunchSpecifications": { "SpotSpecification": { "BlockDurationMinutes": number, "TimeoutAction": "string", "TimeoutDurationMinutes": number } }, "Name": "string", "ProvisionedOnDemandCapacity": number, "ProvisionedSpotCapacity": number, "Status": { "State": "string", "StateChangeReason": { "Code": "string", "Message": "string" }, "Timeline": { "CreationDateTime": number, "EndDateTime": number, "ReadyDateTime": number } }, "TargetOnDemandCapacity": number, "TargetSpotCapacity": number } ], "Marker": "string"}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
InstanceFleets (p. 47)
The list of instance fleets for the cluster and given filters.
Type: Array of InstanceFleet (p. 145) objectsMarker (p. 47)
The pagination token that indicates the next set of results to retrieve.
Type: String
API Version 2009-03-3148
Amazon Elastic MapReduce API ReferenceErrors
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3149
Amazon Elastic MapReduce API ReferenceListInstanceGroups
ListInstanceGroupsProvides all available details about the instance groups in a cluster.
Request Syntax{ "ClusterId": "string", "Marker": "string"}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ClusterId (p. 50)
The identifier of the cluster for which to list the instance groups.
Type: String
Required: YesMarker (p. 50)
The pagination token that indicates the next set of results to retrieve.
Type: String
Required: No
Response Syntax{ "InstanceGroups": [ { "AutoScalingPolicy": { "Constraints": { "MaxCapacity": number, "MinCapacity": number }, "Rules": [ { "Action": { "Market": "string", "SimpleScalingPolicyConfiguration": { "AdjustmentType": "string", "CoolDown": number, "ScalingAdjustment": number } }, "Description": "string", "Name": "string", "Trigger": {
API Version 2009-03-3150
Amazon Elastic MapReduce API ReferenceResponse Syntax
"CloudWatchAlarmDefinition": { "ComparisonOperator": "string", "Dimensions": [ { "Key": "string", "Value": "string" } ], "EvaluationPeriods": number, "MetricName": "string", "Namespace": "string", "Period": number, "Statistic": "string", "Threshold": number, "Unit": "string" } } } ], "Status": { "State": "string", "StateChangeReason": { "Code": "string", "Message": "string" } } }, "BidPrice": "string", "Configurations": [ { "Classification": "string", "Configurations": [ "Configuration" ], "Properties": { "string" : "string" } } ], "ConfigurationsVersion": number, "EbsBlockDevices": [ { "Device": "string", "VolumeSpecification": { "Iops": number, "SizeInGB": number, "VolumeType": "string" } } ], "EbsOptimized": boolean, "Id": "string", "InstanceGroupType": "string", "InstanceType": "string", "LastSuccessfullyAppliedConfigurations": [ { "Classification": "string", "Configurations": [ "Configuration" ], "Properties": { "string" : "string" } } ], "LastSuccessfullyAppliedConfigurationsVersion": number,
API Version 2009-03-3151
Amazon Elastic MapReduce API ReferenceResponse Elements
"Market": "string", "Name": "string", "RequestedInstanceCount": number, "RunningInstanceCount": number, "ShrinkPolicy": { "DecommissionTimeout": number, "InstanceResizePolicy": { "InstancesToProtect": [ "string" ], "InstancesToTerminate": [ "string" ], "InstanceTerminationTimeout": number } }, "Status": { "State": "string", "StateChangeReason": { "Code": "string", "Message": "string" }, "Timeline": { "CreationDateTime": number, "EndDateTime": number, "ReadyDateTime": number } } } ], "Marker": "string"}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
InstanceGroups (p. 50)
The list of instance groups for the cluster and given filters.
Type: Array of InstanceGroup (p. 156) objectsMarker (p. 50)
The pagination token that indicates the next set of results to retrieve.
Type: String
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
API Version 2009-03-3152
Amazon Elastic MapReduce API ReferenceSee Also
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3153
Amazon Elastic MapReduce API ReferenceListInstances
ListInstancesProvides information for all active EC2 instances and EC2 instances terminated in the last 30 days,up to a maximum of 2,000. EC2 instances in any of the following states are considered active:AWAITING_FULFILLMENT, PROVISIONING, BOOTSTRAPPING, RUNNING.
Request Syntax{ "ClusterId": "string", "InstanceFleetId": "string", "InstanceFleetType": "string", "InstanceGroupId": "string", "InstanceGroupTypes": [ "string" ], "InstanceStates": [ "string" ], "Marker": "string"}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ClusterId (p. 54)
The identifier of the cluster for which to list the instances.
Type: String
Required: YesInstanceFleetId (p. 54)
The unique identifier of the instance fleet.
Type: String
Required: NoInstanceFleetType (p. 54)
The node type of the instance fleet. For example MASTER, CORE, or TASK.
Type: String
Valid Values: MASTER | CORE | TASK
Required: NoInstanceGroupId (p. 54)
The identifier of the instance group for which to list the instances.
Type: String
Required: NoInstanceGroupTypes (p. 54)
The type of instance group for which to list the instances.
API Version 2009-03-3154
Amazon Elastic MapReduce API ReferenceResponse Syntax
Type: Array of strings
Valid Values: MASTER | CORE | TASK
Required: NoInstanceStates (p. 54)
A list of instance states that will filter the instances returned with this request.
Type: Array of strings
Valid Values: AWAITING_FULFILLMENT | PROVISIONING | BOOTSTRAPPING | RUNNING |TERMINATED
Required: NoMarker (p. 54)
The pagination token that indicates the next set of results to retrieve.
Type: String
Required: No
Response Syntax{ "Instances": [ { "EbsVolumes": [ { "Device": "string", "VolumeId": "string" } ], "Ec2InstanceId": "string", "Id": "string", "InstanceFleetId": "string", "InstanceGroupId": "string", "InstanceType": "string", "Market": "string", "PrivateDnsName": "string", "PrivateIpAddress": "string", "PublicDnsName": "string", "PublicIpAddress": "string", "Status": { "State": "string", "StateChangeReason": { "Code": "string", "Message": "string" }, "Timeline": { "CreationDateTime": number, "EndDateTime": number, "ReadyDateTime": number } } } ], "Marker": "string"}
API Version 2009-03-3155
Amazon Elastic MapReduce API ReferenceResponse Elements
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
Instances (p. 55)
The list of instances for the cluster and given filters.
Type: Array of Instance (p. 143) objectsMarker (p. 55)
The pagination token that indicates the next set of results to retrieve.
Type: String
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3156
Amazon Elastic MapReduce API ReferenceListSecurityConfigurations
ListSecurityConfigurationsLists all the security configurations visible to this account, providing their creation dates and times, andtheir names. This call returns a maximum of 50 clusters per call, but returns a marker to track the pagingof the cluster list across multiple ListSecurityConfigurations calls.
Request Syntax{ "Marker": "string"}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
Marker (p. 57)
The pagination token that indicates the set of results to retrieve.
Type: String
Required: No
Response Syntax{ "Marker": "string", "SecurityConfigurations": [ { "CreationDateTime": number, "Name": "string" } ]}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
Marker (p. 57)
A pagination token that indicates the next set of results to retrieve. Include the marker in the nextListSecurityConfiguration call to retrieve the next page of results, if required.
Type: StringSecurityConfigurations (p. 57)
The creation date and time, and name, of each security configuration.
API Version 2009-03-3157
Amazon Elastic MapReduce API ReferenceErrors
Type: Array of SecurityConfigurationSummary (p. 202) objects
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3158
Amazon Elastic MapReduce API ReferenceListSteps
ListStepsProvides a list of steps for the cluster in reverse order unless you specify stepIds with the request offilter by StepStates. You can specify a maximum of ten stepIDs.
Request Syntax{ "ClusterId": "string", "Marker": "string", "StepIds": [ "string" ], "StepStates": [ "string" ]}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ClusterId (p. 59)
The identifier of the cluster for which to list the steps.
Type: String
Required: YesMarker (p. 59)
The pagination token that indicates the next set of results to retrieve.
Type: String
Required: NoStepIds (p. 59)
The filter to limit the step list based on the identifier of the steps. You can specify a maximum of tenStep IDs. The character constraint applies to the overall length of the array.
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoStepStates (p. 59)
The filter to limit the step list based on certain states.
Type: Array of strings
Valid Values: PENDING | CANCEL_PENDING | RUNNING | COMPLETED | CANCELLED |FAILED | INTERRUPTED
Required: No
API Version 2009-03-3159
Amazon Elastic MapReduce API ReferenceResponse Syntax
Response Syntax{ "Marker": "string", "Steps": [ { "ActionOnFailure": "string", "Config": { "Args": [ "string" ], "Jar": "string", "MainClass": "string", "Properties": { "string" : "string" } }, "Id": "string", "Name": "string", "Status": { "FailureDetails": { "LogFile": "string", "Message": "string", "Reason": "string" }, "State": "string", "StateChangeReason": { "Code": "string", "Message": "string" }, "Timeline": { "CreationDateTime": number, "EndDateTime": number, "StartDateTime": number } } } ]}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
Marker (p. 60)
The pagination token that indicates the next set of results to retrieve.
Type: String
Steps (p. 60)
The filtered list of steps for the cluster.
Type: Array of StepSummary (p. 216) objects
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
API Version 2009-03-3160
Amazon Elastic MapReduce API ReferenceSee Also
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3161
Amazon Elastic MapReduce API ReferenceModifyCluster
ModifyClusterModifies the number of steps that can be executed concurrently for the cluster specified using ClusterID.
Request Syntax{ "ClusterId": "string", "StepConcurrencyLevel": number}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ClusterId (p. 62)
The unique identifier of the cluster.
Type: String
Required: YesStepConcurrencyLevel (p. 62)
The number of steps that can be executed concurrently. You can specify a maximum of 256 steps.
Type: Integer
Required: No
Response Syntax{ "StepConcurrencyLevel": number}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
StepConcurrencyLevel (p. 62)
The number of steps that can be executed concurrently.
Type: Integer
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
API Version 2009-03-3162
Amazon Elastic MapReduce API ReferenceSee Also
InternalServerError
Indicates that an error occurred while processing the request and that the request was notcompleted.
HTTP Status Code: 400InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3163
Amazon Elastic MapReduce API ReferenceModifyInstanceFleet
ModifyInstanceFleetModifies the target On-Demand and target Spot capacities for the instance fleet with the specifiedInstanceFleetID within the cluster specified using ClusterID. The call either succeeds or fails atomically.
NoteThe instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x versions.
Request Syntax{ "ClusterId": "string", "InstanceFleet": { "InstanceFleetId": "string", "TargetOnDemandCapacity": number, "TargetSpotCapacity": number }}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ClusterId (p. 64)
The unique identifier of the cluster.
Type: String
Required: YesInstanceFleet (p. 64)
The unique identifier of the instance fleet.
Type: InstanceFleetModifyConfig (p. 150) object
Required: Yes
Response ElementsIf the action is successful, the service sends back an HTTP 200 response with an empty HTTP body.
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500
API Version 2009-03-3164
Amazon Elastic MapReduce API ReferenceSee Also
InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3165
Amazon Elastic MapReduce API ReferenceModifyInstanceGroups
ModifyInstanceGroupsModifyInstanceGroups modifies the number of nodes and configuration settings of an instance group.The input parameters include the new target instance count for the group and the instance group ID. Thecall will either succeed or fail atomically.
Request Syntax{ "ClusterId": "string", "InstanceGroups": [ { "Configurations": [ { "Classification": "string", "Configurations": [ "Configuration" ], "Properties": { "string" : "string" } } ], "EC2InstanceIdsToTerminate": [ "string" ], "InstanceCount": number, "InstanceGroupId": "string", "ShrinkPolicy": { "DecommissionTimeout": number, "InstanceResizePolicy": { "InstancesToProtect": [ "string" ], "InstancesToTerminate": [ "string" ], "InstanceTerminationTimeout": number } } } ]}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ClusterId (p. 66)
The ID of the cluster to which the instance group belongs.
Type: String
Required: NoInstanceGroups (p. 66)
Instance groups to change.
Type: Array of InstanceGroupModifyConfig (p. 164) objects
Required: No
API Version 2009-03-3166
Amazon Elastic MapReduce API ReferenceResponse Elements
Response ElementsIf the action is successful, the service sends back an HTTP 200 response with an empty HTTP body.
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerError
Indicates that an error occurred while processing the request and that the request was notcompleted.
HTTP Status Code: 400
Example
Sample Request
POST / HTTP/1.1Content-Type: application/x-amz-json-1.1X-Amz-Target: ElasticMapReduce.ModifyInstanceGroupsContent-Length: 77User-Agent: aws-sdk-ruby/1.9.2 ruby/1.9.3 i386-mingw32Host: us-east-1.elasticmapreduce.amazonaws.comX-Amz-Date: 20130716T205843ZX-Amz-Content-Sha256: bb1af3d0c6c6a1a09f21ccd7f04a0e2e6c9ce5b5810b0f6777560fe4f81bda8cAuthorization: AWS4-HMAC-SHA256 Credential=AKIAIOSFODNN7EXAMPLE/20130716/us-east-1/elasticmapreduce/aws4_request, SignedHeaders=content-length;content-type;host;user-agent;x-amz-content-sha256;x-amz-date;x-amz-target, Signature=17bbbb4448a1f47a14d5657445e9de5cadf16bed58b850585f80865882133b33Accept: */*
{"InstanceGroups": [{ "InstanceGroupId": "ig-1S8NWT31S2OVG", "InstanceCount": 5}]}
Sample Response
HTTP/1.1 200 OKx-amzn-RequestId: 80a74808-ee5a-11e2-90db-69a5154aeb8dContent-Type: application/x-amz-json-1.1Content-Length: 0Date: Tue, 16 Jul 2013 20:58:44 GMT
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET
API Version 2009-03-3167
Amazon Elastic MapReduce API ReferenceSee Also
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3168
Amazon Elastic MapReduce API ReferencePutAutoScalingPolicy
PutAutoScalingPolicyCreates or updates an automatic scaling policy for a core instance group or task instance group in anAmazon EMR cluster. The automatic scaling policy defines how an instance group dynamically adds andterminates EC2 instances in response to the value of a CloudWatch metric.
Request Syntax{ "AutoScalingPolicy": { "Constraints": { "MaxCapacity": number, "MinCapacity": number }, "Rules": [ { "Action": { "Market": "string", "SimpleScalingPolicyConfiguration": { "AdjustmentType": "string", "CoolDown": number, "ScalingAdjustment": number } }, "Description": "string", "Name": "string", "Trigger": { "CloudWatchAlarmDefinition": { "ComparisonOperator": "string", "Dimensions": [ { "Key": "string", "Value": "string" } ], "EvaluationPeriods": number, "MetricName": "string", "Namespace": "string", "Period": number, "Statistic": "string", "Threshold": number, "Unit": "string" } } } ] }, "ClusterId": "string", "InstanceGroupId": "string"}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
AutoScalingPolicy (p. 69)
Specifies the definition of the automatic scaling policy.
API Version 2009-03-3169
Amazon Elastic MapReduce API ReferenceResponse Syntax
Type: AutoScalingPolicy (p. 107) object
Required: YesClusterId (p. 69)
Specifies the ID of a cluster. The instance group to which the automatic scaling policy is applied iswithin this cluster.
Type: String
Required: YesInstanceGroupId (p. 69)
Specifies the ID of the instance group to which the automatic scaling policy is applied.
Type: String
Required: Yes
Response Syntax{ "AutoScalingPolicy": { "Constraints": { "MaxCapacity": number, "MinCapacity": number }, "Rules": [ { "Action": { "Market": "string", "SimpleScalingPolicyConfiguration": { "AdjustmentType": "string", "CoolDown": number, "ScalingAdjustment": number } }, "Description": "string", "Name": "string", "Trigger": { "CloudWatchAlarmDefinition": { "ComparisonOperator": "string", "Dimensions": [ { "Key": "string", "Value": "string" } ], "EvaluationPeriods": number, "MetricName": "string", "Namespace": "string", "Period": number, "Statistic": "string", "Threshold": number, "Unit": "string" } } } ], "Status": { "State": "string",
API Version 2009-03-3170
Amazon Elastic MapReduce API ReferenceResponse Elements
"StateChangeReason": { "Code": "string", "Message": "string" } } }, "ClusterArn": "string", "ClusterId": "string", "InstanceGroupId": "string"}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
AutoScalingPolicy (p. 70)
The automatic scaling policy definition.
Type: AutoScalingPolicyDescription (p. 108) objectClusterArn (p. 70)
The Amazon Resource Name of the cluster.
Type: String
Length Constraints: Minimum length of 20. Maximum length of 2048.ClusterId (p. 70)
Specifies the ID of a cluster. The instance group to which the automatic scaling policy is applied iswithin this cluster.
Type: StringInstanceGroupId (p. 70)
Specifies the ID of the instance group to which the scaling policy is applied.
Type: String
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript
API Version 2009-03-3171
Amazon Elastic MapReduce API ReferenceSee Also
• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3172
Amazon Elastic MapReduce API ReferencePutBlockPublicAccessConfiguration
PutBlockPublicAccessConfigurationCreates or updates an Amazon EMR block public access configuration for your AWS account in thecurrent Region. For more information see Configure Block Public Access for Amazon EMR in the AmazonEMR Management Guide.
Request Syntax{ "BlockPublicAccessConfiguration": { "BlockPublicSecurityGroupRules": boolean, "PermittedPublicSecurityGroupRuleRanges": [ { "MaxRange": number, "MinRange": number } ] }}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
BlockPublicAccessConfiguration (p. 73)
A configuration for Amazon EMR block public access. The configuration applies to all clusterscreated in your account for the current Region. The configuration specifies whether block publicaccess is enabled. If block public access is enabled, security groups associated with the clustercannot have rules that allow inbound traffic from 0.0.0.0/0 or ::/0 on a port, unless the portis specified as an exception using PermittedPublicSecurityGroupRuleRanges in theBlockPublicAccessConfiguration. By default, Port 22 (SSH) is an exception, and public accessis allowed on this port. You can change this by updating BlockPublicSecurityGroupRules toremove the exception.
NoteFor accounts that created clusters in a Region before November 25, 2019, block publicaccess is disabled by default in that Region. To use this feature, you must manually enableand configure it. For accounts that did not create an EMR cluster in a Region before thisdate, block public access is enabled by default in that Region.
Type: BlockPublicAccessConfiguration (p. 111) object
Required: Yes
Response ElementsIf the action is successful, the service sends back an HTTP 200 response with an empty HTTP body.
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
API Version 2009-03-3173
Amazon Elastic MapReduce API ReferenceSee Also
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3174
Amazon Elastic MapReduce API ReferencePutManagedScalingPolicy
PutManagedScalingPolicyCreates or updates a managed scaling policy for an Amazon EMR cluster. The managed scaling policydefines the limits for resources, such as EC2 instances that can be added or terminated from a cluster.The policy only applies to the core and task nodes. The master node cannot be scaled after initialconfiguration.
Request Syntax{ "ClusterId": "string", "ManagedScalingPolicy": { "ComputeLimits": { "MaximumCapacityUnits": number, "MaximumOnDemandCapacityUnits": number, "MinimumCapacityUnits": number, "UnitType": "string" } }}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ClusterId (p. 75)
Specifies the ID of an EMR cluster where the managed scaling policy is attached.
Type: String
Required: YesManagedScalingPolicy (p. 75)
Specifies the constraints for the managed scaling policy.
Type: ManagedScalingPolicy (p. 193) object
Required: Yes
Response ElementsIf the action is successful, the service sends back an HTTP 200 response with an empty HTTP body.
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
API Version 2009-03-3175
Amazon Elastic MapReduce API ReferenceSee Also
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3176
Amazon Elastic MapReduce API ReferenceRemoveAutoScalingPolicy
RemoveAutoScalingPolicyRemoves an automatic scaling policy from a specified instance group within an EMR cluster.
Request Syntax{ "ClusterId": "string", "InstanceGroupId": "string"}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ClusterId (p. 77)
Specifies the ID of a cluster. The instance group to which the automatic scaling policy is applied iswithin this cluster.
Type: String
Required: YesInstanceGroupId (p. 77)
Specifies the ID of the instance group to which the scaling policy is applied.
Type: String
Required: Yes
Response ElementsIf the action is successful, the service sends back an HTTP 200 response with an empty HTTP body.
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript
API Version 2009-03-3177
Amazon Elastic MapReduce API ReferenceSee Also
• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3178
Amazon Elastic MapReduce API ReferenceRemoveManagedScalingPolicy
RemoveManagedScalingPolicyRemoves a managed scaling policy from a specified EMR cluster.
Request Syntax{ "ClusterId": "string"}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ClusterId (p. 79)
Specifies the ID of the cluster from which the managed scaling policy will be removed.
Type: String
Required: Yes
Response ElementsIf the action is successful, the service sends back an HTTP 200 response with an empty HTTP body.
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3179
Amazon Elastic MapReduce API ReferenceRemoveTags
RemoveTagsRemoves tags from an Amazon EMR resource. Tags make it easier to associate clusters in various ways,such as grouping clusters to track your Amazon EMR resource allocation costs. For more information, seeTag Clusters.
The following example removes the stack tag with value Prod from a cluster:
Request Syntax{ "ResourceId": "string", "TagKeys": [ "string" ]}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
ResourceId (p. 80)
The Amazon EMR resource identifier from which tags will be removed. This value must be a clusteridentifier.
Type: String
Required: YesTagKeys (p. 80)
A list of tag keys to remove from a resource.
Type: Array of strings
Required: Yes
Response ElementsIf the action is successful, the service sends back an HTTP 200 response with an empty HTTP body.
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerException
This exception occurs when there is an internal failure in the EMR service.
HTTP Status Code: 500InvalidRequestException
This exception occurs when there is something wrong with user input.
HTTP Status Code: 400
API Version 2009-03-3180
Amazon Elastic MapReduce API ReferenceExamples
Examples
Example
Sample Request
POST / HTTP/1.1 Content-Type: application/x-amz-json-1.1 X-Amz-Target: ElasticMapReduce.RemoveTags AUTHPARAMS { "ResourceId": "j-3U7TSX5GZFD8Y", "Tags": [{ "Key": "stack", "Value": "Prod" }] }
Sample Response
HTTP/1.1 200 OK x-amzn-RequestId: 9da5a349-ed9e-11e2-90db-69a5154aeb8d Content-Type: application/x-amz-json-1.1 Content-Length: 71 Date: Mon, 15 Jul 2013 22:33:47 GMT { }
API Version 2009-03-3181
Amazon Elastic MapReduce API ReferenceExamples
Example
The following example removes the stack and hbase tags from a cluster:
Sample Request
POST / HTTP/1.1 Content-Type: application/x-amz-json-1.1 X-Amz-Target: ElasticMapReduce.RemoveTags AUTHPARAMS { "ResourceId": "j-3U7TSX5GZFD8Y", "Tags": [{ "Key": "stack" }, { "Key": "hbase" }] }
Sample Response
HTTP/1.1 200 OK x-amzn-RequestId: 9da5a349-ed9e-11e2-90db-69a5154aeb8d Content-Type: application/x-amz-json-1.1 Content-Length: 71
API Version 2009-03-3182
Amazon Elastic MapReduce API ReferenceSee Also
Date: Mon, 15 Jul 2013 22:33:47 GMT { }
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3183
Amazon Elastic MapReduce API ReferenceRunJobFlow
RunJobFlowRunJobFlow creates and starts running a new cluster (job flow). The cluster runs the stepsspecified. After the steps complete, the cluster stops and the HDFS partition is lost. To preventloss of data, configure the last step of the job flow to store results in Amazon S3. If theJobFlowInstancesConfig (p. 183) KeepJobFlowAliveWhenNoSteps parameter is set to TRUE, thecluster transitions to the WAITING state rather than shutting down after the steps have completed.
For additional protection, you can set the JobFlowInstancesConfig (p. 183) TerminationProtectedparameter to TRUE to lock the cluster and prevent it from being terminated by API call, userintervention, or in the event of a job flow error.
A maximum of 256 steps are allowed in each job flow.
If your cluster is long-running (such as a Hive data warehouse) or complex, you may require more than256 steps to process your data. You can bypass the 256-step limitation in various ways, including usingthe SSH shell to connect to the master node and submitting queries directly to the software running onthe master node, such as Hive and Hadoop. For more information on how to do this, see Add More than256 Steps to a Cluster in the Amazon EMR Management Guide.
For long running clusters, we recommend that you periodically store your results.
NoteThe instance fleets configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x versions. The RunJobFlow request can contain InstanceFleets parameters orInstanceGroups parameters, but not both.
Request Syntax{ "AdditionalInfo": "string", "AmiVersion": "string", "Applications": [ { "AdditionalInfo": { "string" : "string" }, "Args": [ "string" ], "Name": "string", "Version": "string" } ], "AutoScalingRole": "string", "BootstrapActions": [ { "Name": "string", "ScriptBootstrapAction": { "Args": [ "string" ], "Path": "string" } } ], "Configurations": [ { "Classification": "string", "Configurations": [ "Configuration" ], "Properties": { "string" : "string"
API Version 2009-03-3184
Amazon Elastic MapReduce API ReferenceRequest Syntax
} } ], "CustomAmiId": "string", "EbsRootVolumeSize": number, "Instances": { "AdditionalMasterSecurityGroups": [ "string" ], "AdditionalSlaveSecurityGroups": [ "string" ], "Ec2KeyName": "string", "Ec2SubnetId": "string", "Ec2SubnetIds": [ "string" ], "EmrManagedMasterSecurityGroup": "string", "EmrManagedSlaveSecurityGroup": "string", "HadoopVersion": "string", "InstanceCount": number, "InstanceFleets": [ { "InstanceFleetType": "string", "InstanceTypeConfigs": [ { "BidPrice": "string", "BidPriceAsPercentageOfOnDemandPrice": number, "Configurations": [ { "Classification": "string", "Configurations": [ "Configuration" ], "Properties": { "string" : "string" } } ], "EbsConfiguration": { "EbsBlockDeviceConfigs": [ { "VolumeSpecification": { "Iops": number, "SizeInGB": number, "VolumeType": "string" }, "VolumesPerInstance": number } ], "EbsOptimized": boolean }, "InstanceType": "string", "WeightedCapacity": number } ], "LaunchSpecifications": { "SpotSpecification": { "BlockDurationMinutes": number, "TimeoutAction": "string", "TimeoutDurationMinutes": number } }, "Name": "string", "TargetOnDemandCapacity": number, "TargetSpotCapacity": number } ], "InstanceGroups": [ { "AutoScalingPolicy": { "Constraints": {
API Version 2009-03-3185
Amazon Elastic MapReduce API ReferenceRequest Syntax
"MaxCapacity": number, "MinCapacity": number }, "Rules": [ { "Action": { "Market": "string", "SimpleScalingPolicyConfiguration": { "AdjustmentType": "string", "CoolDown": number, "ScalingAdjustment": number } }, "Description": "string", "Name": "string", "Trigger": { "CloudWatchAlarmDefinition": { "ComparisonOperator": "string", "Dimensions": [ { "Key": "string", "Value": "string" } ], "EvaluationPeriods": number, "MetricName": "string", "Namespace": "string", "Period": number, "Statistic": "string", "Threshold": number, "Unit": "string" } } } ] }, "BidPrice": "string", "Configurations": [ { "Classification": "string", "Configurations": [ "Configuration" ], "Properties": { "string" : "string" } } ], "EbsConfiguration": { "EbsBlockDeviceConfigs": [ { "VolumeSpecification": { "Iops": number, "SizeInGB": number, "VolumeType": "string" }, "VolumesPerInstance": number } ], "EbsOptimized": boolean }, "InstanceCount": number, "InstanceRole": "string", "InstanceType": "string", "Market": "string", "Name": "string"
API Version 2009-03-3186
Amazon Elastic MapReduce API ReferenceRequest Syntax
} ], "KeepJobFlowAliveWhenNoSteps": boolean, "MasterInstanceType": "string", "Placement": { "AvailabilityZone": "string", "AvailabilityZones": [ "string" ] }, "ServiceAccessSecurityGroup": "string", "SlaveInstanceType": "string", "TerminationProtected": boolean }, "JobFlowRole": "string", "KerberosAttributes": { "ADDomainJoinPassword": "string", "ADDomainJoinUser": "string", "CrossRealmTrustPrincipalPassword": "string", "KdcAdminPassword": "string", "Realm": "string" }, "LogEncryptionKmsKeyId": "string", "LogUri": "string", "ManagedScalingPolicy": { "ComputeLimits": { "MaximumCapacityUnits": number, "MaximumOnDemandCapacityUnits": number, "MinimumCapacityUnits": number, "UnitType": "string" } }, "Name": "string", "NewSupportedProducts": [ { "Args": [ "string" ], "Name": "string" } ], "ReleaseLabel": "string", "RepoUpgradeOnBoot": "string", "ScaleDownBehavior": "string", "SecurityConfiguration": "string", "ServiceRole": "string", "StepConcurrencyLevel": number, "Steps": [ { "ActionOnFailure": "string", "HadoopJarStep": { "Args": [ "string" ], "Jar": "string", "MainClass": "string", "Properties": [ { "Key": "string", "Value": "string" } ] }, "Name": "string" } ], "SupportedProducts": [ "string" ], "Tags": [ { "Key": "string", "Value": "string" }
API Version 2009-03-3187
Amazon Elastic MapReduce API ReferenceRequest Parameters
], "VisibleToAllUsers": boolean}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
AdditionalInfo (p. 84)
A JSON string for selecting additional features.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoAmiVersion (p. 84)
Applies only to Amazon EMR AMI versions 3.x and 2.x. For Amazon EMR releases 4.0 and later,ReleaseLabel is used. To specify a custom AMI, use CustomAmiID.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoApplications (p. 84)
Applies to Amazon EMR releases 4.0 and later. A case-insensitive list of applications for AmazonEMR to install and configure when launching the cluster. For a list of applications available for eachAmazon EMR release version, see the Amazon EMR Release Guide.
Type: Array of Application (p. 106) objects
Required: NoAutoScalingRole (p. 84)
An IAM role for automatic scaling policies. The default role is EMR_AutoScaling_DefaultRole.The IAM role provides permissions that the automatic scaling feature requires to launch andterminate EC2 instances in an instance group.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoBootstrapActions (p. 84)
A list of bootstrap actions to run before Hadoop starts on the cluster nodes.
API Version 2009-03-3188
Amazon Elastic MapReduce API ReferenceRequest Parameters
Type: Array of BootstrapActionConfig (p. 113) objects
Required: No
Configurations (p. 84)
For Amazon EMR releases 4.0 and later. The list of configurations supplied for the EMR cluster youare creating.
Type: Array of Configuration (p. 131) objects
Required: No
CustomAmiId (p. 84)
Available only in Amazon EMR version 5.7.0 and later. The ID of a custom Amazon EBS-backedLinux AMI. If specified, Amazon EMR uses this AMI when it launches cluster EC2 instances. Formore information about custom AMIs in Amazon EMR, see Using a Custom AMI in the Amazon EMRManagement Guide. If omitted, the cluster uses the base Linux AMI for the ReleaseLabel specified.For Amazon EMR versions 2.x and 3.x, use AmiVersion instead.
For information about creating a custom AMI, see Creating an Amazon EBS-Backed Linux AMI in theAmazon Elastic Compute Cloud User Guide for Linux Instances. For information about finding an AMIID, see Finding a Linux AMI.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: No
EbsRootVolumeSize (p. 84)
The size, in GiB, of the EBS root device volume of the Linux AMI that is used for each EC2 instance.Available in Amazon EMR version 4.x and later.
Type: Integer
Required: No
Instances (p. 84)
A specification of the number and type of Amazon EC2 instances.
Type: JobFlowInstancesConfig (p. 183) object
Required: Yes
JobFlowRole (p. 84)
Also called instance profile and EC2 role. An IAM role for an EMR cluster. The EC2 instances of thecluster assume this role. The default role is EMR_EC2_DefaultRole. In order to use the default role,you must have already created it using the CLI or console.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: No
API Version 2009-03-3189
Amazon Elastic MapReduce API ReferenceRequest Parameters
KerberosAttributes (p. 84)
Attributes for Kerberos configuration when Kerberos authentication is enabled using a securityconfiguration. For more information see Use Kerberos Authentication in the EMR Management Guide.
Type: KerberosAttributes (p. 190) object
Required: NoLogEncryptionKmsKeyId (p. 84)
The AWS KMS customer master key (CMK) used for encrypting log files. If a value is not provided, thelogs will remain encrypted by AES-256. This attribute is only available with EMR version 5.30.0 andlater, excluding EMR 6.0.0.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoLogUri (p. 84)
The location in Amazon S3 to write the log files of the job flow. If a value is not provided, logs arenot created.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoManagedScalingPolicy (p. 84)
The specified managed scaling policy for an Amazon EMR cluster.
Type: ManagedScalingPolicy (p. 193) object
Required: NoName (p. 84)
The name of the job flow.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: YesNewSupportedProducts (p. 84)
NoteFor Amazon EMR releases 3.x and 2.x. For Amazon EMR releases 4.x and later, useApplications.
A list of strings that indicates third-party software to use with the job flow that accepts a userargument list. EMR accepts and forwards the argument list to the corresponding installation script as
API Version 2009-03-3190
Amazon Elastic MapReduce API ReferenceRequest Parameters
bootstrap action arguments. For more information, see "Launch a Job Flow on the MapR Distributionfor Hadoop" in the Amazon EMR Developer Guide. Supported values are:• "mapr-m3" - launch the cluster using MapR M3 Edition.• "mapr-m5" - launch the cluster using MapR M5 Edition.• "mapr" with the user arguments specifying "--edition,m3" or "--edition,m5" - launch the job flow
using MapR M3 or M5 Edition respectively.• "mapr-m7" - launch the cluster using MapR M7 Edition.• "hunk" - launch the cluster with the Hunk Big Data Analtics Platform.• "hue"- launch the cluster with Hue installed.• "spark" - launch the cluster with Apache Spark installed.• "ganglia" - launch the cluster with the Ganglia Monitoring System installed.
Type: Array of SupportedProductConfig (p. 219) objects
Required: NoReleaseLabel (p. 84)
The Amazon EMR release label, which determines the version of open-source application packagesinstalled on the cluster. Release labels are in the form emr-x.x.x, where x.x.x is an Amazon EMRrelease version such as emr-5.14.0. For more information about Amazon EMR release versionsand included application versions and features, see https://docs.aws.amazon.com/emr/latest/ReleaseGuide/. The release label applies only to Amazon EMR releases version 4.0 and later. Earlierversions use AmiVersion.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoRepoUpgradeOnBoot (p. 84)
Applies only when CustomAmiID is used. Specifies which updates from the Amazon Linux AMIpackage repositories to apply automatically when the instance boots using the AMI. If omitted, thedefault is SECURITY, which indicates that only security updates are applied. If NONE is specified, noupdates are applied, and all updates must be applied manually.
Type: String
Valid Values: SECURITY | NONE
Required: NoScaleDownBehavior (p. 84)
Specifies the way that individual Amazon EC2 instances terminate when an automatic scale-inactivity occurs or an instance group is resized. TERMINATE_AT_INSTANCE_HOUR indicates thatAmazon EMR terminates nodes at the instance-hour boundary, regardless of when the request toterminate the instance was submitted. This option is only available with Amazon EMR 5.1.0 andlater and is the default for clusters created using that version. TERMINATE_AT_TASK_COMPLETIONindicates that Amazon EMR blacklists and drains tasks from nodes before terminating the AmazonEC2 instances, regardless of the instance-hour boundary. With either behavior, Amazon EMRremoves the least active nodes first and blocks instance termination if it could lead to HDFScorruption. TERMINATE_AT_TASK_COMPLETION available only in Amazon EMR version 4.1.0 andlater, and is the default for versions of Amazon EMR earlier than 5.1.0.
Type: String
API Version 2009-03-3191
Amazon Elastic MapReduce API ReferenceRequest Parameters
Valid Values: TERMINATE_AT_INSTANCE_HOUR | TERMINATE_AT_TASK_COMPLETION
Required: NoSecurityConfiguration (p. 84)
The name of a security configuration to apply to the cluster.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoServiceRole (p. 84)
The IAM role that will be assumed by the Amazon EMR service to access AWS resources on yourbehalf.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoStepConcurrencyLevel (p. 84)
Specifies the number of steps that can be executed concurrently. The default value is 1. Themaximum value is 256.
Type: Integer
Required: NoSteps (p. 84)
A list of steps to run.
Type: Array of StepConfig (p. 210) objects
Required: NoSupportedProducts (p. 84)
NoteFor Amazon EMR releases 3.x and 2.x. For Amazon EMR releases 4.x and later, useApplications.
A list of strings that indicates third-party software to use. For more information, see the AmazonEMR Developer Guide. Currently supported values are:• "mapr-m3" - launch the job flow using MapR M3 Edition.• "mapr-m5" - launch the job flow using MapR M5 Edition.
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: No
API Version 2009-03-3192
Amazon Elastic MapReduce API ReferenceResponse Syntax
Tags (p. 84)
A list of tags to associate with a cluster and propagate to Amazon EC2 instances.
Type: Array of Tag (p. 220) objects
Required: NoVisibleToAllUsers (p. 84)
A value of true indicates that all IAM users in the AWS account can perform cluster actions if theyhave the proper IAM policy permissions. This is the default. A value of false indicates that only theIAM user who created the cluster can perform actions.
Type: Boolean
Required: No
Response Syntax{ "ClusterArn": "string", "JobFlowId": "string"}
Response ElementsIf the action is successful, the service sends back an HTTP 200 response.
The following data is returned in JSON format by the service.
ClusterArn (p. 93)
The Amazon Resource Name of the cluster.
Type: String
Length Constraints: Minimum length of 20. Maximum length of 2048.JobFlowId (p. 93)
An unique identifier for the job flow.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerError
Indicates that an error occurred while processing the request and that the request was notcompleted.
HTTP Status Code: 400
API Version 2009-03-3193
Amazon Elastic MapReduce API ReferenceExample
Example
Example 1
Sample Request
POST / HTTP/1.1Content-Type: application/x-amz-json-1.1X-Amz-Target: ElasticMapReduce.RunJobFlowContent-Length: 734User-Agent: aws-sdk-ruby/1.9.2 ruby/1.9.3 i386-mingw32Host: us-east-1.elasticmapreduce.amazonaws.comX-Amz-Date: 20130715T210803ZX-Amz-Content-Sha256: 8676d21986e4628a89fb1232a1344063778d4ffc23d10be02b437e0d53a24db3Authorization: AWS4-HMAC-SHA256 Credential=AKIAIOSFODNN7EXAMPLE/20130715/us-east-1/elasticmapreduce/aws4_request, SignedHeaders=content-length;content-type;host;user-agent;x-amz-content-sha256;x-amz-date;x-amz-target, Signature=71f79725c4dbe77c0e842718485f0b37fe6df69e1153c80f7748ebd9617ca2f3Accept: */*
{ "Name": "Development Job Flow", "Instances": { "KeepJobFlowAliveWhenNoSteps": "false", "TerminationProtected": "false", "InstanceGroups": [{ "Name": "Master Instance Group", "InstanceRole": "MASTER", "InstanceCount": 1, "InstanceType": "m1.small", "Market": "ON_DEMAND" }] }, "Steps": [{ "Name": "Example Streaming Step", "ActionOnFailure": "CANCEL_AND_WAIT", "HadoopJarStep": { "Jar": "/home/hadoop/contrib/streaming/hadoop-streaming.jar", "Args": [ "-input", "s3://elasticmapreduce/samples/wordcount/input", "-output", "s3://examples-bucket/example-output", "-mapper", "s3://elasticmapreduce/samples/wordcount/wordSplitter.py", "-reducer", "aggregate" ] } }], "BootstrapActions": [], "NewSupportedProduct": [], "AmiVersion": "3.8.0"}
Sample Response
HTTP/1.1 200 OKx-amzn-RequestId: a4406d6b-ed92-11e2-9787-192218ecb460Content-Type: application/x-amz-json-1.1
API Version 2009-03-3194
Amazon Elastic MapReduce API ReferenceSee Also
Content-Length: 31Date: Mon, 15 Jul 2013 21:08:05 GMT
{"JobFlowId": "j-ZKIY4CKQRX72"}
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3195
Amazon Elastic MapReduce API ReferenceSetTerminationProtection
SetTerminationProtectionSetTerminationProtection locks a cluster (job flow) so the EC2 instances in the cluster cannot beterminated by user intervention, an API call, or in the event of a job-flow error. The cluster stillterminates upon successful completion of the job flow. Calling SetTerminationProtection on acluster is similar to calling the Amazon EC2 DisableAPITermination API on all EC2 instances in acluster.
SetTerminationProtection is used to prevent accidental termination of a cluster and to ensure thatin the event of an error, the instances persist so that you can recover any data stored in their ephemeralinstance storage.
To terminate a cluster that has been locked by setting SetTerminationProtection to true, you mustfirst unlock the job flow by a subsequent call to SetTerminationProtection in which you set thevalue to false.
For more information, seeManaging Cluster Termination in the Amazon EMR Management Guide.
Request Syntax{ "JobFlowIds": [ "string" ], "TerminationProtected": boolean}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
JobFlowIds (p. 96)
A list of strings that uniquely identify the clusters to protect. This identifier is returned byRunJobFlow (p. 84) and can also be obtained from DescribeJobFlows (p. 28) .
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: YesTerminationProtected (p. 96)
A Boolean that indicates whether to protect the cluster and prevent the Amazon EC2 instances in thecluster from shutting down due to API calls, user intervention, or job-flow error.
Type: Boolean
Required: Yes
Response ElementsIf the action is successful, the service sends back an HTTP 200 response with an empty HTTP body.
API Version 2009-03-3196
Amazon Elastic MapReduce API ReferenceErrors
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerError
Indicates that an error occurred while processing the request and that the request was notcompleted.
HTTP Status Code: 400
Example
Sample Request
POST / HTTP/1.1Content-Type: application/x-amz-json-1.1X-Amz-Target: ElasticMapReduce.SetTerminationProtectionContent-Length: 61User-Agent: aws-sdk-ruby/1.9.2 ruby/1.9.3 i386-mingw32Host: us-east-1.elasticmapreduce.amazonaws.comX-Amz-Date: 20130716T211420ZX-Amz-Content-Sha256: c362fadae0fce377aa63f04388aeb90c53cedb17a8bfbb8cffcb10c2378137f9Authorization: AWS4-HMAC-SHA256 Credential=AKIAIOSFODNN7EXAMPLE/20130716/us-east-1/elasticmapreduce/aws4_request, SignedHeaders=content-length;content-type;host;user-agent;x-amz-content-sha256;x-amz-date;x-amz-target, Signature=764b6aa1a38733cadff35a2e884887e9f1208a422266bc83ac77e8d0b80bd4cfAccept: */*
{ "JobFlowIds": ["j-3TS0OIYO4NFN"], "TerminationProtected": true}
Sample Response
HTTP/1.1 200 OKx-amzn-RequestId: af23b1db-ee5c-11e2-9787-192218ecb460Content-Type: application/x-amz-json-1.1Content-Length: 0Date: Tue, 16 Jul 2013 21:14:21 GMT
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript
API Version 2009-03-3197
Amazon Elastic MapReduce API ReferenceSee Also
• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-3198
Amazon Elastic MapReduce API ReferenceSetVisibleToAllUsers
SetVisibleToAllUsersSets the Cluster:VisibleToAllUsers (p. 122) value, which determines whether the cluster is visible to allIAM users of the AWS account associated with the cluster. Only the IAM user who created the cluster orthe AWS account root user can call this action. The default value, true, indicates that all IAM users in theAWS account can perform cluster actions if they have the proper IAM policy permissions. If set to false,only the IAM user that created the cluster can perform actions. This action works on running clusters.You can override the default true setting when you create a cluster by using the VisibleToAllUsersparameter with RunJobFlow.
Request Syntax
{ "JobFlowIds": [ "string" ], "VisibleToAllUsers": boolean}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
JobFlowIds (p. 99)
The unique identifier of the job flow (cluster).
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: Yes
VisibleToAllUsers (p. 99)
A value of true indicates that all IAM users in the AWS account can perform cluster actions if theyhave the proper IAM policy permissions. This is the default. A value of false indicates that only theIAM user who created the cluster can perform actions.
Type: Boolean
Required: Yes
Response ElementsIf the action is successful, the service sends back an HTTP 200 response with an empty HTTP body.
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
API Version 2009-03-3199
Amazon Elastic MapReduce API ReferenceExample
InternalServerError
Indicates that an error occurred while processing the request and that the request was notcompleted.
HTTP Status Code: 400
Example
Sample Request
POST / HTTP/1.1Content-Type: application/x-amz-json-1.1X-Amz-Target: ElasticMapReduce.SetVisibleToAllUsersContent-Length: 58User-Agent: aws-sdk-ruby/1.9.2 ruby/1.9.3 i386-mingw32Host: us-east-1.elasticmapreduce.amazonaws.comX-Amz-Date: 20130715T221616ZX-Amz-Content-Sha256: 2ff32d11eab2383d764ffcb97571454e798689ecd09a7b1bb2327e22b0b930d4Authorization: AWS4-HMAC-SHA256 Credential=AKIAIOSFODNN7EXAMPLE/20130715/us-east-1/elasticmapreduce/aws4_request, SignedHeaders=content-length;content-type;host;user-agent;x-amz-content-sha256;x-amz-date;x-amz-target, Signature=e1a00b37787d9ccc43c9de32f1f0a73813b0bd6643d4db7762b62a7092d51997Accept: */*
{ "JobFlowIds": ["j-ZKIY4CKQRX72"], "VisibleToAllUsers": true}
Sample Response
HTTP/1.1 200 OKx-amzn-RequestId: 2be9cde9-ed9c-11e2-82b6-2351cde3f33fContent-Type: application/x-amz-json-1.1Content-Length: 0Date: Mon, 15 Jul 2013 22:16:18 GMT
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python
API Version 2009-03-31100
Amazon Elastic MapReduce API ReferenceSee Also
• AWS SDK for Ruby V3
API Version 2009-03-31101
Amazon Elastic MapReduce API ReferenceTerminateJobFlows
TerminateJobFlowsTerminateJobFlows shuts a list of clusters (job flows) down. When a job flow is shut down, any stepnot yet completed is canceled and the EC2 instances on which the cluster is running are stopped. Anylog files not already saved are uploaded to Amazon S3 if a LogUri was specified when the cluster wascreated.
The maximum number of clusters allowed is 10. The call to TerminateJobFlows is asynchronous.Depending on the configuration of the cluster, it may take up to 1-5 minutes for the cluster tocompletely terminate and release allocated resources, such as Amazon EC2 instances.
Request Syntax
{ "JobFlowIds": [ "string" ]}
Request ParametersFor information about the parameters that are common to all actions, see CommonParameters (p. 222).
The request accepts the following data in JSON format.
JobFlowIds (p. 102)
A list of job flows to be shutdown.
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: Yes
Response ElementsIf the action is successful, the service sends back an HTTP 200 response with an empty HTTP body.
ErrorsFor information about the errors that are common to all actions, see Common Errors (p. 224).
InternalServerError
Indicates that an error occurred while processing the request and that the request was notcompleted.
HTTP Status Code: 400
API Version 2009-03-31102
Amazon Elastic MapReduce API ReferenceExample
Example
Sample Request
POST / HTTP/1.1Content-Type: application/x-amz-json-1.1X-Amz-Target: ElasticMapReduce.TerminateJobFlowsContent-Length: 33User-Agent: aws-sdk-ruby/1.9.2 ruby/1.9.3 i386-mingw32Host: us-east-1.elasticmapreduce.amazonaws.comX-Amz-Date: 20130716T211858ZX-Amz-Content-Sha256: ab64713f61e066e80a6083844b9249b6c6362d34a7ae7393047aa46d38b9e315Authorization: AWS4-HMAC-SHA256 Credential=AKIAIOSFODNN7EXAMPLE/20130716/us-east-1/elasticmapreduce/aws4_request, SignedHeaders=content-length;content-type;host;user-agent;x-amz-content-sha256;x-amz-date;x-amz-target, Signature=9791416eaf09f36aa753a324b0de27ff5cc7084b8548cc748487a2bcb3439d58Accept: */*
{"JobFlowIds": ["j-3TS0OIYO4NFN"]}
Sample Response
HTTP/1.1 200 OKx-amzn-RequestId: 5551a7c9-ee5d-11e2-9542-25296c300ff0Content-Type: application/x-amz-json-1.1Content-Length: 0Date: Tue, 16 Jul 2013 21:18:59 GMT
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS Command Line Interface• AWS SDK for .NET• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for JavaScript• AWS SDK for PHP V3• AWS SDK for Python• AWS SDK for Ruby V3
API Version 2009-03-31103
Amazon Elastic MapReduce API Reference
Data TypesThe Amazon Elastic MapReduce API contains several data types that various actions use. This sectiondescribes each data type in detail.
NoteThe order of each element in a data type structure is not guaranteed. Applications should notassume a particular order.
The following data types are supported:
• Application (p. 106)• AutoScalingPolicy (p. 107)• AutoScalingPolicyDescription (p. 108)• AutoScalingPolicyStateChangeReason (p. 109)• AutoScalingPolicyStatus (p. 110)• BlockPublicAccessConfiguration (p. 111)• BlockPublicAccessConfigurationMetadata (p. 112)• BootstrapActionConfig (p. 113)• BootstrapActionDetail (p. 114)• CancelStepsInfo (p. 115)• CloudWatchAlarmDefinition (p. 116)• Cluster (p. 118)• ClusterStateChangeReason (p. 123)• ClusterStatus (p. 124)• ClusterSummary (p. 125)• ClusterTimeline (p. 127)• Command (p. 128)• ComputeLimits (p. 129)• Configuration (p. 131)• EbsBlockDevice (p. 132)• EbsBlockDeviceConfig (p. 133)• EbsConfiguration (p. 134)• EbsVolume (p. 135)• Ec2InstanceAttributes (p. 136)• FailureDetails (p. 139)• HadoopJarStepConfig (p. 140)• HadoopStepConfig (p. 142)• Instance (p. 143)• InstanceFleet (p. 145)• InstanceFleetConfig (p. 148)• InstanceFleetModifyConfig (p. 150)• InstanceFleetProvisioningSpecifications (p. 151)• InstanceFleetStateChangeReason (p. 152)• InstanceFleetStatus (p. 153)• InstanceFleetTimeline (p. 155)
API Version 2009-03-31104
Amazon Elastic MapReduce API Reference
• InstanceGroup (p. 156)• InstanceGroupConfig (p. 159)• InstanceGroupDetail (p. 161)• InstanceGroupModifyConfig (p. 164)• InstanceGroupStateChangeReason (p. 166)• InstanceGroupStatus (p. 167)• InstanceGroupTimeline (p. 168)• InstanceResizePolicy (p. 169)• InstanceStateChangeReason (p. 170)• InstanceStatus (p. 171)• InstanceTimeline (p. 172)• InstanceTypeConfig (p. 173)• InstanceTypeSpecification (p. 175)• JobFlowDetail (p. 177)• JobFlowExecutionStatusDetail (p. 181)• JobFlowInstancesConfig (p. 183)• JobFlowInstancesDetail (p. 187)• KerberosAttributes (p. 190)• KeyValue (p. 192)• ManagedScalingPolicy (p. 193)• MetricDimension (p. 194)• PlacementType (p. 195)• PortRange (p. 196)• ScalingAction (p. 197)• ScalingConstraints (p. 198)• ScalingRule (p. 199)• ScalingTrigger (p. 200)• ScriptBootstrapActionConfig (p. 201)• SecurityConfigurationSummary (p. 202)• ShrinkPolicy (p. 203)• SimpleScalingPolicyConfiguration (p. 204)• SpotProvisioningSpecification (p. 206)• Step (p. 208)• StepConfig (p. 210)• StepDetail (p. 211)• StepExecutionStatusDetail (p. 212)• StepStateChangeReason (p. 214)• StepStatus (p. 215)• StepSummary (p. 216)• StepTimeline (p. 218)• SupportedProductConfig (p. 219)• Tag (p. 220)• VolumeSpecification (p. 221)
API Version 2009-03-31105
Amazon Elastic MapReduce API ReferenceApplication
ApplicationWith Amazon EMR release version 4.0 and later, the only accepted parameter is the application name. Topass arguments to applications, you use configuration classifications specified using configuration JSONobjects. For more information, see Configuring Applications.
With earlier Amazon EMR releases, the application is any Amazon or third-party software that you canadd to the cluster. This structure contains a list of strings that indicates the software to use with thecluster and accepts a user argument list. Amazon EMR accepts and forwards the argument list to thecorresponding installation script as bootstrap action argument.
ContentsAdditionalInfo
This option is for advanced users only. This is meta information about third-party applications thatthird-party vendors use for testing purposes.
Type: String to string map
Required: NoArgs
Arguments for Amazon EMR to pass to the application.
Type: Array of strings
Required: NoName
The name of the application.
Type: String
Required: NoVersion
The version of the application.
Type: String
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31106
Amazon Elastic MapReduce API ReferenceAutoScalingPolicy
AutoScalingPolicyAn automatic scaling policy for a core instance group or task instance group in an Amazon EMR cluster.An automatic scaling policy defines how an instance group dynamically adds and terminates EC2instances in response to the value of a CloudWatch metric. See PutAutoScalingPolicy (p. 69).
ContentsConstraints
The upper and lower EC2 instance limits for an automatic scaling policy. Automatic scaling activitywill not cause an instance group to grow above or below these limits.
Type: ScalingConstraints (p. 198) object
Required: YesRules
The scale-in and scale-out rules that comprise the automatic scaling policy.
Type: Array of ScalingRule (p. 199) objects
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31107
Amazon Elastic MapReduce API ReferenceAutoScalingPolicyDescription
AutoScalingPolicyDescriptionAn automatic scaling policy for a core instance group or task instance group in an Amazon EMR cluster.The automatic scaling policy defines how an instance group dynamically adds and terminates EC2instances in response to the value of a CloudWatch metric. See PutAutoScalingPolicy (p. 69).
ContentsConstraints
The upper and lower EC2 instance limits for an automatic scaling policy. Automatic scaling activitywill not cause an instance group to grow above or below these limits.
Type: ScalingConstraints (p. 198) object
Required: NoRules
The scale-in and scale-out rules that comprise the automatic scaling policy.
Type: Array of ScalingRule (p. 199) objects
Required: NoStatus
The status of an automatic scaling policy.
Type: AutoScalingPolicyStatus (p. 110) object
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31108
Amazon Elastic MapReduce API ReferenceAutoScalingPolicyStateChangeReason
AutoScalingPolicyStateChangeReasonThe reason for an AutoScalingPolicyStatus (p. 110) change.
ContentsCode
The code indicating the reason for the change in status.USER_REQUEST indicates that the scalingpolicy status was changed by a user. PROVISION_FAILURE indicates that the status change wasbecause the policy failed to provision. CLEANUP_FAILURE indicates an error.
Type: String
Valid Values: USER_REQUEST | PROVISION_FAILURE | CLEANUP_FAILURE
Required: NoMessage
A friendly, more verbose message that accompanies an automatic scaling policy state change.
Type: String
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31109
Amazon Elastic MapReduce API ReferenceAutoScalingPolicyStatus
AutoScalingPolicyStatusThe status of an automatic scaling policy.
ContentsState
Indicates the status of the automatic scaling policy.
Type: String
Valid Values: PENDING | ATTACHING | ATTACHED | DETACHING | DETACHED | FAILED
Required: NoStateChangeReason
The reason for a change in status.
Type: AutoScalingPolicyStateChangeReason (p. 109) object
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31110
Amazon Elastic MapReduce API ReferenceBlockPublicAccessConfiguration
BlockPublicAccessConfigurationA configuration for Amazon EMR block public access. When BlockPublicSecurityGroupRules isset to true, Amazon EMR prevents cluster creation if one of the cluster's security groups has a rule thatallows inbound traffic from 0.0.0.0/0 or ::/0 on a port, unless the port is specified as an exception usingPermittedPublicSecurityGroupRuleRanges.
ContentsBlockPublicSecurityGroupRules
Indicates whether EMR block public access is enabled (true) or disabled (false). By default, thevalue is false for accounts that have created EMR clusters before July 2019. For accounts createdafter this, the default is true.
Type: Boolean
Required: YesPermittedPublicSecurityGroupRuleRanges
Specifies ports and port ranges that are permitted to have security group rules that allowinbound traffic from all public sources. For example, if Port 23 (Telnet) is specified forPermittedPublicSecurityGroupRuleRanges, Amazon EMR allows cluster creation if a securitygroup associated with the cluster has a rule that allows inbound traffic on Port 23 from IPv40.0.0.0/0 or IPv6 port ::/0 as the source.
By default, Port 22, which is used for SSH access to the cluster EC2 instances, is in the list ofPermittedPublicSecurityGroupRuleRanges.
Type: Array of PortRange (p. 196) objects
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31111
Amazon Elastic MapReduce API ReferenceBlockPublicAccessConfigurationMetadata
BlockPublicAccessConfigurationMetadataProperties that describe the AWS principal that created the BlockPublicAccessConfigurationusing the PutBlockPublicAccessConfiguration action as well as the date and time that theconfiguration was created. Each time a configuration for block public access is updated, Amazon EMRupdates this metadata.
ContentsCreatedByArn
The Amazon Resource Name that created or last modified the configuration.
Type: String
Length Constraints: Minimum length of 20. Maximum length of 2048.
Required: YesCreationDateTime
The date and time that the configuration was created.
Type: Timestamp
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31112
Amazon Elastic MapReduce API ReferenceBootstrapActionConfig
BootstrapActionConfigConfiguration of a bootstrap action.
ContentsName
The name of the bootstrap action.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: YesScriptBootstrapAction
The script run by the bootstrap action.
Type: ScriptBootstrapActionConfig (p. 201) object
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31113
Amazon Elastic MapReduce API ReferenceBootstrapActionDetail
BootstrapActionDetailReports the configuration of a bootstrap action in a cluster (job flow).
ContentsBootstrapActionConfig
A description of the bootstrap action.
Type: BootstrapActionConfig (p. 113) object
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31114
Amazon Elastic MapReduce API ReferenceCancelStepsInfo
CancelStepsInfoSpecification of the status of a CancelSteps request. Available only in Amazon EMR version 4.8.0 andlater, excluding version 5.0.0.
ContentsReason
The reason for the failure if the CancelSteps request fails.
Type: String
Required: NoStatus
The status of a CancelSteps Request. The value may be SUBMITTED or FAILED.
Type: String
Valid Values: SUBMITTED | FAILED
Required: NoStepId
The encrypted StepId of a step.
Type: String
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31115
Amazon Elastic MapReduce API ReferenceCloudWatchAlarmDefinition
CloudWatchAlarmDefinitionThe definition of a CloudWatch metric alarm, which determines when an automatic scaling activity istriggered. When the defined alarm conditions are satisfied, scaling activity begins.
ContentsComparisonOperator
Determines how the metric specified by MetricName is compared to the value specified byThreshold.
Type: String
Valid Values: GREATER_THAN_OR_EQUAL | GREATER_THAN | LESS_THAN |LESS_THAN_OR_EQUAL
Required: YesDimensions
A CloudWatch metric dimension.
Type: Array of MetricDimension (p. 194) objects
Required: NoEvaluationPeriods
The number of periods, in five-minute increments, during which the alarm condition must existbefore the alarm triggers automatic scaling activity. The default value is 1.
Type: Integer
Required: NoMetricName
The name of the CloudWatch metric that is watched to determine an alarm condition.
Type: String
Required: YesNamespace
The namespace for the CloudWatch metric. The default is AWS/ElasticMapReduce.
Type: String
Required: NoPeriod
The period, in seconds, over which the statistic is applied. EMR CloudWatch metrics are emittedevery five minutes (300 seconds), so if an EMR CloudWatch metric is specified, specify 300.
Type: Integer
Required: YesStatistic
The statistic to apply to the metric associated with the alarm. The default is AVERAGE.
API Version 2009-03-31116
Amazon Elastic MapReduce API ReferenceSee Also
Type: String
Valid Values: SAMPLE_COUNT | AVERAGE | SUM | MINIMUM | MAXIMUM
Required: NoThreshold
The value against which the specified statistic is compared.
Type: Double
Valid Range: Minimum value of 0.0.
Required: YesUnit
The unit of measure associated with the CloudWatch metric being watched. The value specified forUnit must correspond to the units specified in the CloudWatch metric.
Type: String
Valid Values: NONE | SECONDS | MICRO_SECONDS | MILLI_SECONDS | BYTES |KILO_BYTES | MEGA_BYTES | GIGA_BYTES | TERA_BYTES | BITS | KILO_BITS |MEGA_BITS | GIGA_BITS | TERA_BITS | PERCENT | COUNT | BYTES_PER_SECOND| KILO_BYTES_PER_SECOND | MEGA_BYTES_PER_SECOND | GIGA_BYTES_PER_SECOND| TERA_BYTES_PER_SECOND | BITS_PER_SECOND | KILO_BITS_PER_SECOND |MEGA_BITS_PER_SECOND | GIGA_BITS_PER_SECOND | TERA_BITS_PER_SECOND |COUNT_PER_SECOND
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31117
Amazon Elastic MapReduce API ReferenceCluster
ClusterThe detailed description of the cluster.
ContentsApplications
The applications installed on this cluster.
Type: Array of Application (p. 106) objects
Required: NoAutoScalingRole
An IAM role for automatic scaling policies. The default role is EMR_AutoScaling_DefaultRole.The IAM role provides permissions that the automatic scaling feature requires to launch andterminate EC2 instances in an instance group.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoAutoTerminate
Specifies whether the cluster should terminate after completing all steps.
Type: Boolean
Required: NoClusterArn
The Amazon Resource Name of the cluster.
Type: String
Length Constraints: Minimum length of 20. Maximum length of 2048.
Required: NoConfigurations
Applies only to Amazon EMR releases 4.x and later. The list of Configurations supplied to the EMRcluster.
Type: Array of Configuration (p. 131) objects
Required: NoCustomAmiId
Available only in Amazon EMR version 5.7.0 and later. The ID of a custom Amazon EBS-backed LinuxAMI if the cluster uses a custom AMI.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
API Version 2009-03-31118
Amazon Elastic MapReduce API ReferenceContents
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoEbsRootVolumeSize
The size, in GiB, of the EBS root device volume of the Linux AMI that is used for each EC2 instance.Available in Amazon EMR version 4.x and later.
Type: Integer
Required: NoEc2InstanceAttributes
Provides information about the EC2 instances in a cluster grouped by category. For example, keyname, subnet ID, IAM instance profile, and so on.
Type: Ec2InstanceAttributes (p. 136) object
Required: NoId
The unique identifier for the cluster.
Type: String
Required: NoInstanceCollectionType
NoteThe instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x versions.
The instance group configuration of the cluster. A value of INSTANCE_GROUP indicates auniform instance group configuration. A value of INSTANCE_FLEET indicates an instance fleetsconfiguration.
Type: String
Valid Values: INSTANCE_FLEET | INSTANCE_GROUP
Required: NoKerberosAttributes
Attributes for Kerberos configuration when Kerberos authentication is enabled using a securityconfiguration. For more information see Use Kerberos Authentication in the EMR Management Guide.
Type: KerberosAttributes (p. 190) object
Required: NoLogEncryptionKmsKeyId
The AWS KMS customer master key (CMK) used for encrypting log files. This attribute is onlyavailable with EMR version 5.30.0 and later, excluding EMR 6.0.0.
Type: String
Required: NoLogUri
The path to the Amazon S3 location where logs for this cluster are stored.
API Version 2009-03-31119
Amazon Elastic MapReduce API ReferenceContents
Type: String
Required: NoMasterPublicDnsName
The DNS name of the master node. If the cluster is on a private subnet, this is the private DNS name.On a public subnet, this is the public DNS name.
Type: String
Required: NoName
The name of the cluster.
Type: String
Required: NoNormalizedInstanceHours
An approximation of the cost of the cluster, represented in m1.small/hours. This value isincremented one time for every hour an m1.small instance runs. Larger instances are weighted more,so an EC2 instance that is roughly four times more expensive would result in the normalized instancehours being incremented by four. This result is only an approximation and does not reflect the actualbilling rate.
Type: Integer
Required: NoOutpostArn
The Amazon Resource Name (ARN) of the Outpost where the cluster is launched.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 2048.
Required: NoReleaseLabel
The Amazon EMR release label, which determines the version of open-source application packagesinstalled on the cluster. Release labels are in the form emr-x.x.x, where x.x.x is an Amazon EMRrelease version such as emr-5.14.0. For more information about Amazon EMR release versionsand included application versions and features, see https://docs.aws.amazon.com/emr/latest/ReleaseGuide/. The release label applies only to Amazon EMR releases version 4.0 and later. Earlierversions use AmiVersion.
Type: String
Required: NoRepoUpgradeOnBoot
Applies only when CustomAmiID is used. Specifies the type of updates that are applied from theAmazon Linux AMI package repositories when an instance boots using the AMI.
Type: String
Valid Values: SECURITY | NONE
API Version 2009-03-31120
Amazon Elastic MapReduce API ReferenceContents
Required: NoRequestedAmiVersion
The AMI version requested for this cluster.
Type: String
Required: NoRunningAmiVersion
The AMI version running on this cluster.
Type: String
Required: NoScaleDownBehavior
The way that individual Amazon EC2 instances terminate when an automatic scale-in activity occursor an instance group is resized. TERMINATE_AT_INSTANCE_HOUR indicates that Amazon EMRterminates nodes at the instance-hour boundary, regardless of when the request to terminatethe instance was submitted. This option is only available with Amazon EMR 5.1.0 and later and isthe default for clusters created using that version. TERMINATE_AT_TASK_COMPLETION indicatesthat Amazon EMR blacklists and drains tasks from nodes before terminating the Amazon EC2instances, regardless of the instance-hour boundary. With either behavior, Amazon EMR removesthe least active nodes first and blocks instance termination if it could lead to HDFS corruption.TERMINATE_AT_TASK_COMPLETION is available only in Amazon EMR version 4.1.0 and later, and isthe default for versions of Amazon EMR earlier than 5.1.0.
Type: String
Valid Values: TERMINATE_AT_INSTANCE_HOUR | TERMINATE_AT_TASK_COMPLETION
Required: NoSecurityConfiguration
The name of the security configuration applied to the cluster.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoServiceRole
The IAM role that will be assumed by the Amazon EMR service to access AWS resources on yourbehalf.
Type: String
Required: NoStatus
The current status details about the cluster.
Type: ClusterStatus (p. 124) object
Required: No
API Version 2009-03-31121
Amazon Elastic MapReduce API ReferenceSee Also
StepConcurrencyLevel
Specifies the number of steps that can be executed concurrently.
Type: Integer
Required: NoTags
A list of tags associated with a cluster.
Type: Array of Tag (p. 220) objects
Required: NoTerminationProtected
Indicates whether Amazon EMR will lock the cluster to prevent the EC2 instances from beingterminated by an API call or user intervention, or in the event of a cluster error.
Type: Boolean
Required: NoVisibleToAllUsers
Indicates whether the cluster is visible to all IAM users of the AWS account associated with thecluster. The default value, true, indicates that all IAM users in the AWS account can perform clusteractions if they have the proper IAM policy permissions. If this value is false, only the IAM user thatcreated the cluster can perform actions. This value can be changed on a running cluster by using theSetVisibleToAllUsers (p. 99) action. You can override the default value of true when you create acluster by using the VisibleToAllUsers parameter of the RunJobFlow action.
Type: Boolean
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31122
Amazon Elastic MapReduce API ReferenceClusterStateChangeReason
ClusterStateChangeReasonThe reason that the cluster changed to its current state.
ContentsCode
The programmatic code for the state change reason.
Type: String
Valid Values: INTERNAL_ERROR | VALIDATION_ERROR | INSTANCE_FAILURE |INSTANCE_FLEET_TIMEOUT | BOOTSTRAP_FAILURE | USER_REQUEST | STEP_FAILURE |ALL_STEPS_COMPLETED
Required: NoMessage
The descriptive message for the state change reason.
Type: String
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31123
Amazon Elastic MapReduce API ReferenceClusterStatus
ClusterStatusThe detailed status of the cluster.
ContentsState
The current state of the cluster.
Type: String
Valid Values: STARTING | BOOTSTRAPPING | RUNNING | WAITING | TERMINATING |TERMINATED | TERMINATED_WITH_ERRORS
Required: NoStateChangeReason
The reason for the cluster status change.
Type: ClusterStateChangeReason (p. 123) object
Required: NoTimeline
A timeline that represents the status of a cluster over the lifetime of the cluster.
Type: ClusterTimeline (p. 127) object
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31124
Amazon Elastic MapReduce API ReferenceClusterSummary
ClusterSummaryThe summary description of the cluster.
ContentsClusterArn
The Amazon Resource Name of the cluster.
Type: String
Length Constraints: Minimum length of 20. Maximum length of 2048.
Required: No
Id
The unique identifier for the cluster.
Type: String
Required: No
Name
The name of the cluster.
Type: String
Required: No
NormalizedInstanceHours
An approximation of the cost of the cluster, represented in m1.small/hours. This value isincremented one time for every hour an m1.small instance runs. Larger instances are weighted more,so an EC2 instance that is roughly four times more expensive would result in the normalized instancehours being incremented by four. This result is only an approximation and does not reflect the actualbilling rate.
Type: Integer
Required: No
OutpostArn
The Amazon Resource Name (ARN) of the Outpost where the cluster is launched.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 2048.
Required: No
Status
The details about the current status of the cluster.
Type: ClusterStatus (p. 124) object
Required: No
API Version 2009-03-31125
Amazon Elastic MapReduce API ReferenceSee Also
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31126
Amazon Elastic MapReduce API ReferenceClusterTimeline
ClusterTimelineRepresents the timeline of the cluster's lifecycle.
ContentsCreationDateTime
The creation date and time of the cluster.
Type: Timestamp
Required: NoEndDateTime
The date and time when the cluster was terminated.
Type: Timestamp
Required: NoReadyDateTime
The date and time when the cluster was ready to execute steps.
Type: Timestamp
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31127
Amazon Elastic MapReduce API ReferenceCommand
CommandAn entity describing an executable that runs on a cluster.
ContentsArgs
Arguments for Amazon EMR to pass to the command for execution.
Type: Array of strings
Required: NoName
The name of the command.
Type: String
Required: NoScriptPath
The Amazon S3 location of the command script.
Type: String
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31128
Amazon Elastic MapReduce API ReferenceComputeLimits
ComputeLimitsThe EC2 unit limits for a managed scaling policy. The managed scaling activity of a cluster can not beabove or below these limits. The limit only applies to the core and task nodes. The master node cannotbe scaled after initial configuration.
ContentsMaximumCapacityUnits
The upper boundary of EC2 units. It is measured through VCPU cores or instances for instancegroups and measured through units for instance fleets. Managed scaling activities are not allowedbeyond this boundary. The limit only applies to the core and task nodes. The master node cannot bescaled after initial configuration.
Type: Integer
Required: YesMaximumOnDemandCapacityUnits
The upper boundary of on-demand EC2 units. It is measured through VCPU cores or instances forinstance groups and measured through units for instance fleets. The on-demand units are notallowed to scale beyond this boundary. The limit only applies to the core and task nodes. The masternode cannot be scaled after initial configuration.
Type: Integer
Required: NoMinimumCapacityUnits
The lower boundary of EC2 units. It is measured through VCPU cores or instances for instance groupsand measured through units for instance fleets. Managed scaling activities are not allowed beyondthis boundary. The limit only applies to the core and task nodes. The master node cannot be scaledafter initial configuration.
Type: Integer
Required: YesUnitType
The unit type used for specifying a managed scaling policy.
Type: String
Valid Values: InstanceFleetUnits | Instances | VCPU
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java
API Version 2009-03-31129
Amazon Elastic MapReduce API ReferenceSee Also
• AWS SDK for Ruby V3
API Version 2009-03-31130
Amazon Elastic MapReduce API ReferenceConfiguration
ConfigurationNoteAmazon EMR releases 4.x or later.
An optional configuration specification to be used when provisioning cluster instances, which caninclude configurations for applications and software bundled with Amazon EMR. A configurationconsists of a classification, properties, and optional nested configurations. A classification refers to anapplication-specific configuration file. Properties are the settings you want to change in that file. Formore information, see Configuring Applications.
ContentsClassification
The classification within a configuration.
Type: String
Required: NoConfigurations
A list of additional configurations to apply within a configuration object.
Type: Array of Configuration (p. 131) objects
Required: NoProperties
A set of properties specified within a configuration classification.
Type: String to string map
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31131
Amazon Elastic MapReduce API ReferenceEbsBlockDevice
EbsBlockDeviceConfiguration of requested EBS block device associated with the instance group.
ContentsDevice
The device name that is exposed to the instance, such as /dev/sdh.
Type: String
Required: NoVolumeSpecification
EBS volume specifications such as volume type, IOPS, and size (GiB) that will be requested for theEBS volume attached to an EC2 instance in the cluster.
Type: VolumeSpecification (p. 221) object
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31132
Amazon Elastic MapReduce API ReferenceEbsBlockDeviceConfig
EbsBlockDeviceConfigConfiguration of requested EBS block device associated with the instance group with count of volumesthat will be associated to every instance.
ContentsVolumeSpecification
EBS volume specifications such as volume type, IOPS, and size (GiB) that will be requested for theEBS volume attached to an EC2 instance in the cluster.
Type: VolumeSpecification (p. 221) object
Required: YesVolumesPerInstance
Number of EBS volumes with a specific volume configuration that will be associated with everyinstance in the instance group
Type: Integer
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31133
Amazon Elastic MapReduce API ReferenceEbsConfiguration
EbsConfigurationThe Amazon EBS configuration of a cluster instance.
ContentsEbsBlockDeviceConfigs
An array of Amazon EBS volume specifications attached to a cluster instance.
Type: Array of EbsBlockDeviceConfig (p. 133) objects
Required: NoEbsOptimized
Indicates whether an Amazon EBS volume is EBS-optimized.
Type: Boolean
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31134
Amazon Elastic MapReduce API ReferenceEbsVolume
EbsVolumeEBS block device that's attached to an EC2 instance.
ContentsDevice
The device name that is exposed to the instance, such as /dev/sdh.
Type: String
Required: NoVolumeId
The volume identifier of the EBS volume.
Type: String
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31135
Amazon Elastic MapReduce API ReferenceEc2InstanceAttributes
Ec2InstanceAttributesProvides information about the EC2 instances in a cluster grouped by category. For example, key name,subnet ID, IAM instance profile, and so on.
ContentsAdditionalMasterSecurityGroups
A list of additional Amazon EC2 security group IDs for the master node.
Type: Array of strings
Required: NoAdditionalSlaveSecurityGroups
A list of additional Amazon EC2 security group IDs for the core and task nodes.
Type: Array of strings
Required: NoEc2AvailabilityZone
The Availability Zone in which the cluster will run.
Type: String
Required: NoEc2KeyName
The name of the Amazon EC2 key pair to use when connecting with SSH into the master node as auser named "hadoop".
Type: String
Required: NoEc2SubnetId
Set this parameter to the identifier of the Amazon VPC subnet where you want the cluster to launch.If you do not specify this value, and your account supports EC2-Classic, the cluster launches in EC2-Classic.
Type: String
Required: NoEmrManagedMasterSecurityGroup
The identifier of the Amazon EC2 security group for the master node.
Type: String
Required: NoEmrManagedSlaveSecurityGroup
The identifier of the Amazon EC2 security group for the core and task nodes.
Type: String
API Version 2009-03-31136
Amazon Elastic MapReduce API ReferenceSee Also
Required: NoIamInstanceProfile
The IAM role that was specified when the cluster was launched. The EC2 instances of the clusterassume this role.
Type: String
Required: NoRequestedEc2AvailabilityZones
Applies to clusters configured with the instance fleets option. Specifies one or more AvailabilityZones in which to launch EC2 cluster instances when the EC2-Classic network configuration issupported. Amazon EMR chooses the Availability Zone with the best fit from among the listof RequestedEc2AvailabilityZones, and then launches all cluster instances within thatAvailability Zone. If you do not specify this value, Amazon EMR chooses the Availability Zone for you.RequestedEc2SubnetIDs and RequestedEc2AvailabilityZones cannot be specified together.
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoRequestedEc2SubnetIds
Applies to clusters configured with the instance fleets option. Specifies the unique identifier ofone or more Amazon EC2 subnets in which to launch EC2 cluster instances. Subnets must existwithin the same VPC. Amazon EMR chooses the EC2 subnet with the best fit from among the list ofRequestedEc2SubnetIds, and then launches all cluster instances within that Subnet. If this valueis not specified, and the account and Region support EC2-Classic networks, the cluster launchesinstances in the EC2-Classic network and uses RequestedEc2AvailabilityZones instead of thissetting. If EC2-Classic is not supported, and no Subnet is specified, Amazon EMR chooses the subnetfor you. RequestedEc2SubnetIDs and RequestedEc2AvailabilityZones cannot be specifiedtogether.
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoServiceAccessSecurityGroup
The identifier of the Amazon EC2 security group for the Amazon EMR service to access clusters inVPC private subnets.
Type: String
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++
API Version 2009-03-31137
Amazon Elastic MapReduce API ReferenceSee Also
• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31138
Amazon Elastic MapReduce API ReferenceFailureDetails
FailureDetailsThe details of the step failure. The service attempts to detect the root cause for many common failures.
ContentsLogFile
The path to the log file where the step failure root cause was originally recorded.
Type: String
Required: NoMessage
The descriptive message including the error the EMR service has identified as the cause of stepfailure. This is text from an error log that describes the root cause of the failure.
Type: String
Required: NoReason
The reason for the step failure. In the case where the service cannot successfully determine the rootcause of the failure, it returns "Unknown Error" as a reason.
Type: String
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31139
Amazon Elastic MapReduce API ReferenceHadoopJarStepConfig
HadoopJarStepConfigA job flow step consisting of a JAR file whose main function will be executed. The main function submitsa job for Hadoop to execute and waits for the job to finish or fail.
ContentsArgs
A list of command line arguments passed to the JAR file's main function when executed.
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoJar
A path to a JAR file run during the step.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: YesMainClass
The name of the main class in the specified Java file. If not specified, the JAR file should specify aMain-Class in its manifest file.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoProperties
A list of Java properties that are set when the step runs. You can use these properties to pass keyvalue pairs to your main function.
Type: Array of KeyValue (p. 192) objects
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go
API Version 2009-03-31140
Amazon Elastic MapReduce API ReferenceSee Also
• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31141
Amazon Elastic MapReduce API ReferenceHadoopStepConfig
HadoopStepConfigA cluster step consisting of a JAR file whose main function will be executed. The main function submits ajob for Hadoop to execute and waits for the job to finish or fail.
ContentsArgs
The list of command line arguments to pass to the JAR file's main function for execution.
Type: Array of strings
Required: NoJar
The path to the JAR file that runs during the step.
Type: String
Required: NoMainClass
The name of the main class in the specified Java file. If not specified, the JAR file should specify amain class in its manifest file.
Type: String
Required: NoProperties
The list of Java properties that are set when the step runs. You can use these properties to pass keyvalue pairs to your main function.
Type: String to string map
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31142
Amazon Elastic MapReduce API ReferenceInstance
InstanceRepresents an EC2 instance provisioned as part of cluster.
ContentsEbsVolumes
The list of EBS volumes that are attached to this instance.
Type: Array of EbsVolume (p. 135) objects
Required: NoEc2InstanceId
The unique identifier of the instance in Amazon EC2.
Type: String
Required: NoId
The unique identifier for the instance in Amazon EMR.
Type: String
Required: NoInstanceFleetId
The unique identifier of the instance fleet to which an EC2 instance belongs.
Type: String
Required: NoInstanceGroupId
The identifier of the instance group to which this instance belongs.
Type: String
Required: NoInstanceType
The EC2 instance type, for example m3.xlarge.
Type: String
Length Constraints: Minimum length of 1. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoMarket
The instance purchasing option. Valid values are ON_DEMAND or SPOT.
Type: String
API Version 2009-03-31143
Amazon Elastic MapReduce API ReferenceSee Also
Valid Values: ON_DEMAND | SPOT
Required: NoPrivateDnsName
The private DNS name of the instance.
Type: String
Required: NoPrivateIpAddress
The private IP address of the instance.
Type: String
Required: NoPublicDnsName
The public DNS name of the instance.
Type: String
Required: NoPublicIpAddress
The public IP address of the instance.
Type: String
Required: NoStatus
The current status of the instance.
Type: InstanceStatus (p. 171) object
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31144
Amazon Elastic MapReduce API ReferenceInstanceFleet
InstanceFleetDescribes an instance fleet, which is a group of EC2 instances that host a particular node type (master,core, or task) in an Amazon EMR cluster. Instance fleets can consist of a mix of instance types and On-Demand and Spot instances, which are provisioned to meet a defined target capacity.
NoteThe instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x versions.
ContentsId
The unique identifier of the instance fleet.
Type: String
Required: NoInstanceFleetType
The node type that the instance fleet hosts. Valid values are MASTER, CORE, or TASK.
Type: String
Valid Values: MASTER | CORE | TASK
Required: NoInstanceTypeSpecifications
The specification for the instance types that comprise an instance fleet. Up to five unique instancespecifications may be defined for each instance fleet.
Type: Array of InstanceTypeSpecification (p. 175) objects
Required: NoLaunchSpecifications
Describes the launch specification for an instance fleet.
Type: InstanceFleetProvisioningSpecifications (p. 151) object
Required: NoName
A friendly name for the instance fleet.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoProvisionedOnDemandCapacity
The number of On-Demand units that have been provisioned for the instance fleet to fulfillTargetOnDemandCapacity. This provisioned capacity might be less than or greater thanTargetOnDemandCapacity.
API Version 2009-03-31145
Amazon Elastic MapReduce API ReferenceContents
Type: Integer
Valid Range: Minimum value of 0.
Required: NoProvisionedSpotCapacity
The number of Spot units that have been provisioned for this instance fleet to fulfillTargetSpotCapacity. This provisioned capacity might be less than or greater thanTargetSpotCapacity.
Type: Integer
Valid Range: Minimum value of 0.
Required: NoStatus
The current status of the instance fleet.
Type: InstanceFleetStatus (p. 153) object
Required: NoTargetOnDemandCapacity
The target capacity of On-Demand units for the instance fleet, which determines how manyOn-Demand instances to provision. When the instance fleet launches, Amazon EMR tries toprovision On-Demand instances as specified by InstanceTypeConfig (p. 173). Each instanceconfiguration has a specified WeightedCapacity. When an On-Demand instance is provisioned,the WeightedCapacity units count toward the target capacity. Amazon EMR provisions instancesuntil the target capacity is totally fulfilled, even if this results in an overage. For example, if thereare 2 units remaining to fulfill capacity, and Amazon EMR can only provision an instance with aWeightedCapacity of 5 units, the instance is provisioned, and the target capacity is exceeded by3 units. You can use InstanceFleet:ProvisionedOnDemandCapacity (p. 145) to determine the Spotcapacity units that have been provisioned for the instance fleet.
NoteIf not specified or set to 0, only Spot instances are provisioned for the instancefleet using TargetSpotCapacity. At least one of TargetSpotCapacity andTargetOnDemandCapacity should be greater than 0. For a master instance fleet, only oneof TargetSpotCapacity and TargetOnDemandCapacity can be specified, and its valuemust be 1.
Type: Integer
Valid Range: Minimum value of 0.
Required: NoTargetSpotCapacity
The target capacity of Spot units for the instance fleet, which determines how many Spotinstances to provision. When the instance fleet launches, Amazon EMR tries to provision Spotinstances as specified by InstanceTypeConfig (p. 173). Each instance configuration has a specifiedWeightedCapacity. When a Spot instance is provisioned, the WeightedCapacity units counttoward the target capacity. Amazon EMR provisions instances until the target capacity is totallyfulfilled, even if this results in an overage. For example, if there are 2 units remaining to fulfillcapacity, and Amazon EMR can only provision an instance with a WeightedCapacity of 5units, the instance is provisioned, and the target capacity is exceeded by 3 units. You can useInstanceFleet:ProvisionedSpotCapacity (p. 146) to determine the Spot capacity units that havebeen provisioned for the instance fleet.
API Version 2009-03-31146
Amazon Elastic MapReduce API ReferenceSee Also
NoteIf not specified or set to 0, only On-Demand instances are provisioned for the instancefleet. At least one of TargetSpotCapacity and TargetOnDemandCapacity shouldbe greater than 0. For a master instance fleet, only one of TargetSpotCapacity andTargetOnDemandCapacity can be specified, and its value must be 1.
Type: Integer
Valid Range: Minimum value of 0.
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31147
Amazon Elastic MapReduce API ReferenceInstanceFleetConfig
InstanceFleetConfigThe configuration that defines an instance fleet.
NoteThe instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x versions.
ContentsInstanceFleetType
The node type that the instance fleet hosts. Valid values are MASTER,CORE,and TASK.
Type: String
Valid Values: MASTER | CORE | TASK
Required: YesInstanceTypeConfigs
The instance type configurations that define the EC2 instances in the instance fleet.
Type: Array of InstanceTypeConfig (p. 173) objects
Required: NoLaunchSpecifications
The launch specification for the instance fleet.
Type: InstanceFleetProvisioningSpecifications (p. 151) object
Required: NoName
The friendly name of the instance fleet.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoTargetOnDemandCapacity
The target capacity of On-Demand units for the instance fleet, which determines how manyOn-Demand instances to provision. When the instance fleet launches, Amazon EMR tries toprovision On-Demand instances as specified by InstanceTypeConfig (p. 173). Each instanceconfiguration has a specified WeightedCapacity. When an On-Demand instance is provisioned,the WeightedCapacity units count toward the target capacity. Amazon EMR provisions instancesuntil the target capacity is totally fulfilled, even if this results in an overage. For example, if thereare 2 units remaining to fulfill capacity, and Amazon EMR can only provision an instance with aWeightedCapacity of 5 units, the instance is provisioned, and the target capacity is exceeded by 3units.
NoteIf not specified or set to 0, only Spot instances are provisioned for the instancefleet using TargetSpotCapacity. At least one of TargetSpotCapacity and
API Version 2009-03-31148
Amazon Elastic MapReduce API ReferenceSee Also
TargetOnDemandCapacity should be greater than 0. For a master instance fleet, only oneof TargetSpotCapacity and TargetOnDemandCapacity can be specified, and its valuemust be 1.
Type: Integer
Valid Range: Minimum value of 0.
Required: NoTargetSpotCapacity
The target capacity of Spot units for the instance fleet, which determines how many Spotinstances to provision. When the instance fleet launches, Amazon EMR tries to provision Spotinstances as specified by InstanceTypeConfig (p. 173). Each instance configuration has a specifiedWeightedCapacity. When a Spot instance is provisioned, the WeightedCapacity units counttoward the target capacity. Amazon EMR provisions instances until the target capacity is totallyfulfilled, even if this results in an overage. For example, if there are 2 units remaining to fulfillcapacity, and Amazon EMR can only provision an instance with a WeightedCapacity of 5 units, theinstance is provisioned, and the target capacity is exceeded by 3 units.
NoteIf not specified or set to 0, only On-Demand instances are provisioned for the instancefleet. At least one of TargetSpotCapacity and TargetOnDemandCapacity shouldbe greater than 0. For a master instance fleet, only one of TargetSpotCapacity andTargetOnDemandCapacity can be specified, and its value must be 1.
Type: Integer
Valid Range: Minimum value of 0.
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31149
Amazon Elastic MapReduce API ReferenceInstanceFleetModifyConfig
InstanceFleetModifyConfigConfiguration parameters for an instance fleet modification request.
NoteThe instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x versions.
ContentsInstanceFleetId
A unique identifier for the instance fleet.
Type: String
Required: YesTargetOnDemandCapacity
The target capacity of On-Demand units for the instance fleet. For more information seeInstanceFleetConfig:TargetOnDemandCapacity (p. 148).
Type: Integer
Valid Range: Minimum value of 0.
Required: NoTargetSpotCapacity
The target capacity of Spot units for the instance fleet. For more information, seeInstanceFleetConfig:TargetSpotCapacity (p. 149).
Type: Integer
Valid Range: Minimum value of 0.
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31150
Amazon Elastic MapReduce API ReferenceInstanceFleetProvisioningSpecifications
InstanceFleetProvisioningSpecificationsThe launch specification for Spot instances in the fleet, which determines the defined duration andprovisioning timeout behavior.
NoteThe instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x versions.
ContentsSpotSpecification
The launch specification for Spot instances in the fleet, which determines the defined duration andprovisioning timeout behavior.
Type: SpotProvisioningSpecification (p. 206) object
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31151
Amazon Elastic MapReduce API ReferenceInstanceFleetStateChangeReason
InstanceFleetStateChangeReasonProvides status change reason details for the instance fleet.
NoteThe instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x versions.
ContentsCode
A code corresponding to the reason the state change occurred.
Type: String
Valid Values: INTERNAL_ERROR | VALIDATION_ERROR | INSTANCE_FAILURE |CLUSTER_TERMINATED
Required: NoMessage
An explanatory message.
Type: String
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31152
Amazon Elastic MapReduce API ReferenceInstanceFleetStatus
InstanceFleetStatusThe status of the instance fleet.
NoteThe instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x versions.
ContentsState
A code representing the instance fleet status.• PROVISIONING—The instance fleet is provisioning EC2 resources and is not yet ready to run jobs.• BOOTSTRAPPING—EC2 instances and other resources have been provisioned and the bootstrap
actions specified for the instances are underway.• RUNNING—EC2 instances and other resources are running. They are either executing jobs or
waiting to execute jobs.• RESIZING—A resize operation is underway. EC2 instances are either being added or removed.• SUSPENDED—A resize operation could not complete. Existing EC2 instances are running, but
instances can't be added or removed.• TERMINATING—The instance fleet is terminating EC2 instances.• TERMINATED—The instance fleet is no longer active, and all EC2 instances have been terminated.
Type: String
Valid Values: PROVISIONING | BOOTSTRAPPING | RUNNING | RESIZING | SUSPENDED |TERMINATING | TERMINATED
Required: NoStateChangeReason
Provides status change reason details for the instance fleet.
Type: InstanceFleetStateChangeReason (p. 152) object
Required: NoTimeline
Provides historical timestamps for the instance fleet, including the time of creation, the time itbecame ready to run jobs, and the time of termination.
Type: InstanceFleetTimeline (p. 155) object
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java
API Version 2009-03-31153
Amazon Elastic MapReduce API ReferenceSee Also
• AWS SDK for Ruby V3
API Version 2009-03-31154
Amazon Elastic MapReduce API ReferenceInstanceFleetTimeline
InstanceFleetTimelineProvides historical timestamps for the instance fleet, including the time of creation, the time it becameready to run jobs, and the time of termination.
NoteThe instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x versions.
ContentsCreationDateTime
The time and date the instance fleet was created.
Type: Timestamp
Required: NoEndDateTime
The time and date the instance fleet terminated.
Type: Timestamp
Required: NoReadyDateTime
The time and date the instance fleet was ready to run jobs.
Type: Timestamp
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31155
Amazon Elastic MapReduce API ReferenceInstanceGroup
InstanceGroupThis entity represents an instance group, which is a group of instances that have common purpose. Forexample, CORE instance group is used for HDFS.
ContentsAutoScalingPolicy
An automatic scaling policy for a core instance group or task instance group in an AmazonEMR cluster. The automatic scaling policy defines how an instance group dynamically adds andterminates EC2 instances in response to the value of a CloudWatch metric. See PutAutoScalingPolicy.
Type: AutoScalingPolicyDescription (p. 108) object
Required: NoBidPrice
The bid price for each EC2 Spot instance type as defined by InstanceType. Expressed inUSD. If neither BidPrice nor BidPriceAsPercentageOfOnDemandPrice is provided,BidPriceAsPercentageOfOnDemandPrice defaults to 100%.
Type: String
Required: NoConfigurations
NoteAmazon EMR releases 4.x or later.
The list of configurations supplied for an EMR cluster instance group. You can specify a separateconfiguration for each instance group (master, core, and task).
Type: Array of Configuration (p. 131) objects
Required: NoConfigurationsVersion
The version number of the requested configuration specification for this instance group.
Type: Long
Required: NoEbsBlockDevices
The EBS block devices that are mapped to this instance group.
Type: Array of EbsBlockDevice (p. 132) objects
Required: NoEbsOptimized
If the instance group is EBS-optimized. An Amazon EBS-optimized instance uses an optimizedconfiguration stack and provides additional, dedicated capacity for Amazon EBS I/O.
Type: Boolean
Required: No
API Version 2009-03-31156
Amazon Elastic MapReduce API ReferenceContents
Id
The identifier of the instance group.
Type: String
Required: NoInstanceGroupType
The type of the instance group. Valid values are MASTER, CORE or TASK.
Type: String
Valid Values: MASTER | CORE | TASK
Required: NoInstanceType
The EC2 instance type for all instances in the instance group.
Type: String
Length Constraints: Minimum length of 1. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoLastSuccessfullyAppliedConfigurations
A list of configurations that were successfully applied for an instance group last time.
Type: Array of Configuration (p. 131) objects
Required: NoLastSuccessfullyAppliedConfigurationsVersion
The version number of a configuration specification that was successfully applied for an instancegroup last time.
Type: Long
Required: NoMarket
The marketplace to provision instances for this group. Valid values are ON_DEMAND or SPOT.
Type: String
Valid Values: ON_DEMAND | SPOT
Required: NoName
The name of the instance group.
Type: String
Required: NoRequestedInstanceCount
The target number of instances for the instance group.
API Version 2009-03-31157
Amazon Elastic MapReduce API ReferenceSee Also
Type: Integer
Required: NoRunningInstanceCount
The number of instances currently running in this instance group.
Type: Integer
Required: NoShrinkPolicy
Policy for customizing shrink operations.
Type: ShrinkPolicy (p. 203) object
Required: NoStatus
The current status of the instance group.
Type: InstanceGroupStatus (p. 167) object
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31158
Amazon Elastic MapReduce API ReferenceInstanceGroupConfig
InstanceGroupConfigConfiguration defining a new instance group.
ContentsAutoScalingPolicy
An automatic scaling policy for a core instance group or task instance group in an AmazonEMR cluster. The automatic scaling policy defines how an instance group dynamicallyadds and terminates EC2 instances in response to the value of a CloudWatch metric. SeePutAutoScalingPolicy (p. 69).
Type: AutoScalingPolicy (p. 107) object
Required: NoBidPrice
The bid price for each EC2 Spot instance type as defined by InstanceType. Expressed inUSD. If neither BidPrice nor BidPriceAsPercentageOfOnDemandPrice is provided,BidPriceAsPercentageOfOnDemandPrice defaults to 100%.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoConfigurations
NoteAmazon EMR releases 4.x or later.
The list of configurations supplied for an EMR cluster instance group. You can specify a separateconfiguration for each instance group (master, core, and task).
Type: Array of Configuration (p. 131) objects
Required: NoEbsConfiguration
EBS configurations that will be attached to each EC2 instance in the instance group.
Type: EbsConfiguration (p. 134) object
Required: NoInstanceCount
Target number of instances for the instance group.
Type: Integer
Required: YesInstanceRole
The role of the instance group in the cluster.
API Version 2009-03-31159
Amazon Elastic MapReduce API ReferenceSee Also
Type: String
Valid Values: MASTER | CORE | TASK
Required: YesInstanceType
The EC2 instance type for all instances in the instance group.
Type: String
Length Constraints: Minimum length of 1. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: YesMarket
Market type of the EC2 instances used to create a cluster node.
Type: String
Valid Values: ON_DEMAND | SPOT
Required: NoName
Friendly name given to the instance group.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31160
Amazon Elastic MapReduce API ReferenceInstanceGroupDetail
InstanceGroupDetailDetailed information about an instance group.
ContentsBidPrice
The bid price for each EC2 Spot instance type as defined by InstanceType. Expressed inUSD. If neither BidPrice nor BidPriceAsPercentageOfOnDemandPrice is provided,BidPriceAsPercentageOfOnDemandPrice defaults to 100%.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoCreationDateTime
The date/time the instance group was created.
Type: Timestamp
Required: YesEndDateTime
The date/time the instance group was terminated.
Type: Timestamp
Required: NoInstanceGroupId
Unique identifier for the instance group.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoInstanceRequestCount
Target number of instances to run in the instance group.
Type: Integer
Required: YesInstanceRole
Instance group role in the cluster
Type: String
Valid Values: MASTER | CORE | TASK
API Version 2009-03-31161
Amazon Elastic MapReduce API ReferenceContents
Required: YesInstanceRunningCount
Actual count of running instances.
Type: Integer
Required: YesInstanceType
EC2 instance type.
Type: String
Length Constraints: Minimum length of 1. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: YesLastStateChangeReason
Details regarding the state of the instance group.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoMarket
Market type of the EC2 instances used to create a cluster node.
Type: String
Valid Values: ON_DEMAND | SPOT
Required: YesName
Friendly name for the instance group.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoReadyDateTime
The date/time the instance group was available to the cluster.
Type: Timestamp
Required: NoStartDateTime
The date/time the instance group was started.
API Version 2009-03-31162
Amazon Elastic MapReduce API ReferenceSee Also
Type: Timestamp
Required: NoState
State of instance group. The following values are deprecated: STARTING, TERMINATED, and FAILED.
Type: String
Valid Values: PROVISIONING | BOOTSTRAPPING | RUNNING | RECONFIGURING | RESIZING| SUSPENDED | TERMINATING | TERMINATED | ARRESTED | SHUTTING_DOWN | ENDED
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31163
Amazon Elastic MapReduce API ReferenceInstanceGroupModifyConfig
InstanceGroupModifyConfigModify the size or configurations of an instance group.
ContentsConfigurations
A list of new or modified configurations to apply for an instance group.
Type: Array of Configuration (p. 131) objects
Required: NoEC2InstanceIdsToTerminate
The EC2 InstanceIds to terminate. After you terminate the instances, the instance group will notreturn to its original requested size.
Type: Array of strings
Required: NoInstanceCount
Target size for the instance group.
Type: Integer
Required: NoInstanceGroupId
Unique ID of the instance group to expand or shrink.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: YesShrinkPolicy
Policy for customizing shrink operations.
Type: ShrinkPolicy (p. 203) object
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31164
Amazon Elastic MapReduce API ReferenceSee Also
API Version 2009-03-31165
Amazon Elastic MapReduce API ReferenceInstanceGroupStateChangeReason
InstanceGroupStateChangeReasonThe status change reason details for the instance group.
ContentsCode
The programmable code for the state change reason.
Type: String
Valid Values: INTERNAL_ERROR | VALIDATION_ERROR | INSTANCE_FAILURE |CLUSTER_TERMINATED
Required: NoMessage
The status change reason description.
Type: String
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31166
Amazon Elastic MapReduce API ReferenceInstanceGroupStatus
InstanceGroupStatusThe details of the instance group status.
ContentsState
The current state of the instance group.
Type: String
Valid Values: PROVISIONING | BOOTSTRAPPING | RUNNING | RECONFIGURING | RESIZING| SUSPENDED | TERMINATING | TERMINATED | ARRESTED | SHUTTING_DOWN | ENDED
Required: NoStateChangeReason
The status change reason details for the instance group.
Type: InstanceGroupStateChangeReason (p. 166) object
Required: NoTimeline
The timeline of the instance group status over time.
Type: InstanceGroupTimeline (p. 168) object
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31167
Amazon Elastic MapReduce API ReferenceInstanceGroupTimeline
InstanceGroupTimelineThe timeline of the instance group lifecycle.
ContentsCreationDateTime
The creation date and time of the instance group.
Type: Timestamp
Required: NoEndDateTime
The date and time when the instance group terminated.
Type: Timestamp
Required: NoReadyDateTime
The date and time when the instance group became ready to perform tasks.
Type: Timestamp
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31168
Amazon Elastic MapReduce API ReferenceInstanceResizePolicy
InstanceResizePolicyCustom policy for requesting termination protection or termination of specific instances when shrinkingan instance group.
ContentsInstancesToProtect
Specific list of instances to be protected when shrinking an instance group.
Type: Array of strings
Required: NoInstancesToTerminate
Specific list of instances to be terminated when shrinking an instance group.
Type: Array of strings
Required: NoInstanceTerminationTimeout
Decommissioning timeout override for the specific list of instances to be terminated.
Type: Integer
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31169
Amazon Elastic MapReduce API ReferenceInstanceStateChangeReason
InstanceStateChangeReasonThe details of the status change reason for the instance.
ContentsCode
The programmable code for the state change reason.
Type: String
Valid Values: INTERNAL_ERROR | VALIDATION_ERROR | INSTANCE_FAILURE |BOOTSTRAP_FAILURE | CLUSTER_TERMINATED
Required: NoMessage
The status change reason description.
Type: String
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31170
Amazon Elastic MapReduce API ReferenceInstanceStatus
InstanceStatusThe instance status details.
ContentsState
The current state of the instance.
Type: String
Valid Values: AWAITING_FULFILLMENT | PROVISIONING | BOOTSTRAPPING | RUNNING |TERMINATED
Required: NoStateChangeReason
The details of the status change reason for the instance.
Type: InstanceStateChangeReason (p. 170) object
Required: NoTimeline
The timeline of the instance status over time.
Type: InstanceTimeline (p. 172) object
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31171
Amazon Elastic MapReduce API ReferenceInstanceTimeline
InstanceTimelineThe timeline of the instance lifecycle.
ContentsCreationDateTime
The creation date and time of the instance.
Type: Timestamp
Required: NoEndDateTime
The date and time when the instance was terminated.
Type: Timestamp
Required: NoReadyDateTime
The date and time when the instance was ready to perform tasks.
Type: Timestamp
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31172
Amazon Elastic MapReduce API ReferenceInstanceTypeConfig
InstanceTypeConfigAn instance type configuration for each instance type in an instance fleet, which determines the EC2instances Amazon EMR attempts to provision to fulfill On-Demand and Spot target capacities. There canbe a maximum of 5 instance type configurations in a fleet.
NoteThe instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x versions.
ContentsBidPrice
The bid price for each EC2 Spot instance type as defined by InstanceType. Expressed inUSD. If neither BidPrice nor BidPriceAsPercentageOfOnDemandPrice is provided,BidPriceAsPercentageOfOnDemandPrice defaults to 100%.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoBidPriceAsPercentageOfOnDemandPrice
The bid price, as a percentage of On-Demand price, for each EC2 Spot instance asdefined by InstanceType. Expressed as a number (for example, 20 specifies 20%).If neither BidPrice nor BidPriceAsPercentageOfOnDemandPrice is provided,BidPriceAsPercentageOfOnDemandPrice defaults to 100%.
Type: Double
Valid Range: Minimum value of 0.0.
Required: NoConfigurations
A configuration classification that applies when provisioning cluster instances, which can includeconfigurations for applications and software that run on the cluster.
Type: Array of Configuration (p. 131) objects
Required: NoEbsConfiguration
The configuration of Amazon Elastic Block Storage (EBS) attached to each instance as defined byInstanceType.
Type: EbsConfiguration (p. 134) object
Required: NoInstanceType
An EC2 instance type, such as m3.xlarge.
Type: String
API Version 2009-03-31173
Amazon Elastic MapReduce API ReferenceSee Also
Length Constraints: Minimum length of 1. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: YesWeightedCapacity
The number of units that a provisioned instance of this type provides toward fulfilling the targetcapacities defined in InstanceFleetConfig (p. 148). This value is 1 for a master instance fleet, andmust be 1 or greater for core and task instance fleets. Defaults to 1 if not specified.
Type: Integer
Valid Range: Minimum value of 0.
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31174
Amazon Elastic MapReduce API ReferenceInstanceTypeSpecification
InstanceTypeSpecificationThe configuration specification for each instance type in an instance fleet.
NoteThe instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x versions.
ContentsBidPrice
The bid price for each EC2 Spot instance type as defined by InstanceType. Expressed in USD.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoBidPriceAsPercentageOfOnDemandPrice
The bid price, as a percentage of On-Demand price, for each EC2 Spot instance as defined byInstanceType. Expressed as a number (for example, 20 specifies 20%).
Type: Double
Valid Range: Minimum value of 0.0.
Required: NoConfigurations
A configuration classification that applies when provisioning cluster instances, which can includeconfigurations for applications and software bundled with Amazon EMR.
Type: Array of Configuration (p. 131) objects
Required: NoEbsBlockDevices
The configuration of Amazon Elastic Block Storage (EBS) attached to each instance as defined byInstanceType.
Type: Array of EbsBlockDevice (p. 132) objects
Required: NoEbsOptimized
Evaluates to TRUE when the specified InstanceType is EBS-optimized.
Type: Boolean
Required: NoInstanceType
The EC2 instance type, for example m3.xlarge.
Type: String
API Version 2009-03-31175
Amazon Elastic MapReduce API ReferenceSee Also
Length Constraints: Minimum length of 1. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoWeightedCapacity
The number of units that a provisioned instance of this type provides toward fulfilling thetarget capacities defined in InstanceFleetConfig (p. 148). Capacity values represent performancecharacteristics such as vCPUs, memory, or I/O. If not specified, the default value is 1.
Type: Integer
Valid Range: Minimum value of 0.
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31176
Amazon Elastic MapReduce API ReferenceJobFlowDetail
JobFlowDetailA description of a cluster (job flow).
ContentsAmiVersion
Applies only to Amazon EMR AMI versions 3.x and 2.x. For Amazon EMR releases 4.0 and later,ReleaseLabel is used. To specify a custom AMI, use CustomAmiID.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoAutoScalingRole
An IAM role for automatic scaling policies. The default role is EMR_AutoScaling_DefaultRole.The IAM role provides a way for the automatic scaling feature to get the required permissions itneeds to launch and terminate EC2 instances in an instance group.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoBootstrapActions
A list of the bootstrap actions run by the job flow.
Type: Array of BootstrapActionDetail (p. 114) objects
Required: NoExecutionStatusDetail
Describes the execution status of the job flow.
Type: JobFlowExecutionStatusDetail (p. 181) object
Required: YesInstances
Describes the Amazon EC2 instances of the job flow.
Type: JobFlowInstancesDetail (p. 187) object
Required: YesJobFlowId
The job flow identifier.
Type: String
API Version 2009-03-31177
Amazon Elastic MapReduce API ReferenceContents
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: YesJobFlowRole
The IAM role that was specified when the job flow was launched. The EC2 instances of the job flowassume this role.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoLogEncryptionKmsKeyId
The AWS KMS customer master key (CMK) used for encrypting log files. This attribute is onlyavailable with EMR version 5.30.0 and later, excluding EMR 6.0.0.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoLogUri
The location in Amazon S3 where log files for the job are stored.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoName
The name of the job flow.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: YesScaleDownBehavior
The way that individual Amazon EC2 instances terminate when an automatic scale-in activity occursor an instance group is resized. TERMINATE_AT_INSTANCE_HOUR indicates that Amazon EMRterminates nodes at the instance-hour boundary, regardless of when the request to terminatethe instance was submitted. This option is only available with Amazon EMR 5.1.0 and later and isthe default for clusters created using that version. TERMINATE_AT_TASK_COMPLETION indicatesthat Amazon EMR blacklists and drains tasks from nodes before terminating the Amazon EC2instances, regardless of the instance-hour boundary. With either behavior, Amazon EMR removes
API Version 2009-03-31178
Amazon Elastic MapReduce API ReferenceSee Also
the least active nodes first and blocks instance termination if it could lead to HDFS corruption.TERMINATE_AT_TASK_COMPLETION available only in Amazon EMR version 4.1.0 and later, and isthe default for versions of Amazon EMR earlier than 5.1.0.
Type: String
Valid Values: TERMINATE_AT_INSTANCE_HOUR | TERMINATE_AT_TASK_COMPLETION
Required: NoServiceRole
The IAM role that will be assumed by the Amazon EMR service to access AWS resources on yourbehalf.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoSteps
A list of steps run by the job flow.
Type: Array of StepDetail (p. 211) objects
Required: NoSupportedProducts
A list of strings set by third party software when the job flow is launched. If you are not using thirdparty software to manage the job flow this value is empty.
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoVisibleToAllUsers
Indicates whether the cluster is visible to all IAM users of the AWS account associated with thecluster. The default value, true, indicates that all IAM users in the AWS account can perform clusteractions if they have the proper IAM policy permissions. If this value is false, only the IAM user thatcreated the cluster can perform actions. This value can be changed on a running cluster by using theSetVisibleToAllUsers (p. 99) action. You can override the default value of true when you create acluster by using the VisibleToAllUsers parameter of the RunJobFlow action.
Type: Boolean
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++
API Version 2009-03-31179
Amazon Elastic MapReduce API ReferenceSee Also
• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31180
Amazon Elastic MapReduce API ReferenceJobFlowExecutionStatusDetail
JobFlowExecutionStatusDetailDescribes the status of the cluster (job flow).
ContentsCreationDateTime
The creation date and time of the job flow.
Type: Timestamp
Required: Yes
EndDateTime
The completion date and time of the job flow.
Type: Timestamp
Required: No
LastStateChangeReason
Description of the job flow last changed state.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: No
ReadyDateTime
The date and time when the job flow was ready to start running bootstrap actions.
Type: Timestamp
Required: No
StartDateTime
The start date and time of the job flow.
Type: Timestamp
Required: No
State
The state of the job flow.
Type: String
Valid Values: STARTING | BOOTSTRAPPING | RUNNING | WAITING | SHUTTING_DOWN |TERMINATED | COMPLETED | FAILED
Required: Yes
API Version 2009-03-31181
Amazon Elastic MapReduce API ReferenceSee Also
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31182
Amazon Elastic MapReduce API ReferenceJobFlowInstancesConfig
JobFlowInstancesConfigA description of the Amazon EC2 instance on which the cluster (job flow) runs. A validJobFlowInstancesConfig must contain either InstanceGroups or InstanceFleets, which is therecommended configuration. They cannot be used together. You may also have MasterInstanceType,SlaveInstanceType, and InstanceCount (all three must be present), but we don't recommend thisconfiguration.
ContentsAdditionalMasterSecurityGroups
A list of additional Amazon EC2 security group IDs for the master node.
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoAdditionalSlaveSecurityGroups
A list of additional Amazon EC2 security group IDs for the core and task nodes.
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoEc2KeyName
The name of the EC2 key pair that can be used to ssh to the master node as the user called"hadoop."
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoEc2SubnetId
Applies to clusters that use the uniform instance group configuration. To launch the cluster inAmazon Virtual Private Cloud (Amazon VPC), set this parameter to the identifier of the AmazonVPC subnet where you want the cluster to launch. If you do not specify this value and your accountsupports EC2-Classic, the cluster launches in EC2-Classic.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: No
API Version 2009-03-31183
Amazon Elastic MapReduce API ReferenceContents
Ec2SubnetIds
Applies to clusters that use the instance fleet configuration. When multiple EC2 subnet IDs arespecified, Amazon EMR evaluates them and launches instances in the optimal subnet.
NoteThe instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x versions.
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: No
EmrManagedMasterSecurityGroup
The identifier of the Amazon EC2 security group for the master node.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: No
EmrManagedSlaveSecurityGroup
The identifier of the Amazon EC2 security group for the core and task nodes.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: No
HadoopVersion
Applies only to Amazon EMR release versions earlier than 4.0. The Hadoop version for the cluster.Valid inputs are "0.18" (deprecated), "0.20" (deprecated), "0.20.205" (deprecated), "1.0.3", "2.2.0", or"2.4.0". If you do not set this value, the default of 0.18 is used, unless the AmiVersion parameter isset in the RunJobFlow call, in which case the default version of Hadoop for that AMI version is used.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: No
InstanceCount
The number of EC2 instances in the cluster.
Type: Integer
Required: No
API Version 2009-03-31184
Amazon Elastic MapReduce API ReferenceContents
InstanceFleets
NoteThe instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x versions.
Describes the EC2 instances and instance configurations for clusters that use the instance fleetconfiguration.
Type: Array of InstanceFleetConfig (p. 148) objects
Required: NoInstanceGroups
Configuration for the instance groups in a cluster.
Type: Array of InstanceGroupConfig (p. 159) objects
Required: NoKeepJobFlowAliveWhenNoSteps
Specifies whether the cluster should remain available after completing all steps.
Type: Boolean
Required: NoMasterInstanceType
The EC2 instance type of the master node.
Type: String
Length Constraints: Minimum length of 1. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoPlacement
The Availability Zone in which the cluster runs.
Type: PlacementType (p. 195) object
Required: NoServiceAccessSecurityGroup
The identifier of the Amazon EC2 security group for the Amazon EMR service to access clusters inVPC private subnets.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoSlaveInstanceType
The EC2 instance type of the core and task nodes.
Type: String
API Version 2009-03-31185
Amazon Elastic MapReduce API ReferenceSee Also
Length Constraints: Minimum length of 1. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoTerminationProtected
Specifies whether to lock the cluster to prevent the Amazon EC2 instances from being terminated byAPI call, user intervention, or in the event of a job-flow error.
Type: Boolean
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31186
Amazon Elastic MapReduce API ReferenceJobFlowInstancesDetail
JobFlowInstancesDetailSpecify the type of Amazon EC2 instances that the cluster (job flow) runs on.
ContentsEc2KeyName
The name of an Amazon EC2 key pair that can be used to ssh to the master node.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoEc2SubnetId
For clusters launched within Amazon Virtual Private Cloud, this is the identifier of the subnet wherethe cluster was launched.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoHadoopVersion
The Hadoop version for the cluster.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoInstanceCount
The number of Amazon EC2 instances in the cluster. If the value is 1, the same instance serves asboth the master and core and task node. If the value is greater than 1, one instance is the masternode and all others are core and task nodes.
Type: Integer
Required: YesInstanceGroups
Details about the instance groups in a cluster.
Type: Array of InstanceGroupDetail (p. 161) objects
Required: NoKeepJobFlowAliveWhenNoSteps
Specifies whether the cluster should remain available after completing all steps.
API Version 2009-03-31187
Amazon Elastic MapReduce API ReferenceContents
Type: Boolean
Required: NoMasterInstanceId
The Amazon EC2 instance identifier of the master node.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoMasterInstanceType
The Amazon EC2 master node instance type.
Type: String
Length Constraints: Minimum length of 1. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: YesMasterPublicDnsName
The DNS name of the master node. If the cluster is on a private subnet, this is the private DNS name.On a public subnet, this is the public DNS name.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoNormalizedInstanceHours
An approximation of the cost of the cluster, represented in m1.small/hours. This value isincremented one time for every hour that an m1.small runs. Larger instances are weighted more, soan Amazon EC2 instance that is roughly four times more expensive would result in the normalizedinstance hours being incremented by four. This result is only an approximation and does not reflectthe actual billing rate.
Type: Integer
Required: NoPlacement
The Amazon EC2 Availability Zone for the cluster.
Type: PlacementType (p. 195) object
Required: NoSlaveInstanceType
The Amazon EC2 core and task node instance type.
Type: String
API Version 2009-03-31188
Amazon Elastic MapReduce API ReferenceSee Also
Length Constraints: Minimum length of 1. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: YesTerminationProtected
Specifies whether the Amazon EC2 instances in the cluster are protected from termination by APIcalls, user intervention, or in the event of a job-flow error.
Type: Boolean
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31189
Amazon Elastic MapReduce API ReferenceKerberosAttributes
KerberosAttributesAttributes for Kerberos configuration when Kerberos authentication is enabled using a securityconfiguration. For more information see Use Kerberos Authentication in the EMR Management Guide.
ContentsADDomainJoinPassword
The Active Directory password for ADDomainJoinUser.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoADDomainJoinUser
Required only when establishing a cross-realm trust with an Active Directory domain. A user withsufficient privileges to join resources to the domain.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoCrossRealmTrustPrincipalPassword
Required only when establishing a cross-realm trust with a KDC in a different realm. The cross-realmprincipal password, which must be identical across realms.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoKdcAdminPassword
The password used within the cluster for the kadmin service on the cluster-dedicated KDC, whichmaintains Kerberos principals, password policies, and keytabs for the cluster.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: YesRealm
The name of the Kerberos realm to which all nodes in a cluster belong. For example,EC2.INTERNAL.
API Version 2009-03-31190
Amazon Elastic MapReduce API ReferenceSee Also
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31191
Amazon Elastic MapReduce API ReferenceKeyValue
KeyValueA key value pair.
ContentsKey
The unique identifier of a key value pair.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoValue
The value part of the identified key.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31192
Amazon Elastic MapReduce API ReferenceManagedScalingPolicy
ManagedScalingPolicyManaged scaling policy for an Amazon EMR cluster. The policy specifies the limits for resources that canbe added or terminated from a cluster. The policy only applies to the core and task nodes. The masternode cannot be scaled after initial configuration.
ContentsComputeLimits
The EC2 unit limits for a managed scaling policy. The managed scaling activity of a cluster is notallowed to go above or below these limits. The limit only applies to the core and task nodes. Themaster node cannot be scaled after initial configuration.
Type: ComputeLimits (p. 129) object
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31193
Amazon Elastic MapReduce API ReferenceMetricDimension
MetricDimensionA CloudWatch dimension, which is specified using a Key (known as a Name in CloudWatch), Valuepair. By default, Amazon EMR uses one dimension whose Key is JobFlowID and Value is a variablerepresenting the cluster ID, which is ${emr.clusterId}. This enables the rule to bootstrap when thecluster ID becomes available.
ContentsKey
The dimension name.
Type: String
Required: NoValue
The dimension value.
Type: String
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31194
Amazon Elastic MapReduce API ReferencePlacementType
PlacementTypeThe Amazon EC2 Availability Zone configuration of the cluster (job flow).
ContentsAvailabilityZone
The Amazon EC2 Availability Zone for the cluster. AvailabilityZone is used for uniform instancegroups, while AvailabilityZones (plural) is used for instance fleets.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoAvailabilityZones
When multiple Availability Zones are specified, Amazon EMR evaluates them and launchesinstances in the optimal Availability Zone. AvailabilityZones is used for instance fleets, whileAvailabilityZone (singular) is used for uniform instance groups.
NoteThe instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x versions.
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31195
Amazon Elastic MapReduce API ReferencePortRange
PortRangeA list of port ranges that are permitted to allow inbound traffic from all public IP addresses. To specify asingle port, use the same value for MinRange and MaxRange.
ContentsMaxRange
The smallest port number in a specified range of port numbers.
Type: Integer
Valid Range: Minimum value of 0. Maximum value of 65535.
Required: NoMinRange
The smallest port number in a specified range of port numbers.
Type: Integer
Valid Range: Minimum value of 0. Maximum value of 65535.
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31196
Amazon Elastic MapReduce API ReferenceScalingAction
ScalingActionThe type of adjustment the automatic scaling activity makes when triggered, and the periodicity of theadjustment.
ContentsMarket
Not available for instance groups. Instance groups use the market type specified for the group.
Type: String
Valid Values: ON_DEMAND | SPOT
Required: NoSimpleScalingPolicyConfiguration
The type of adjustment the automatic scaling activity makes when triggered, and the periodicity ofthe adjustment.
Type: SimpleScalingPolicyConfiguration (p. 204) object
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31197
Amazon Elastic MapReduce API ReferenceScalingConstraints
ScalingConstraintsThe upper and lower EC2 instance limits for an automatic scaling policy. Automatic scaling activitiestriggered by automatic scaling rules will not cause an instance group to grow above or below theselimits.
ContentsMaxCapacity
The upper boundary of EC2 instances in an instance group beyond which scaling activities are notallowed to grow. Scale-out activities will not add instances beyond this boundary.
Type: Integer
Required: YesMinCapacity
The lower boundary of EC2 instances in an instance group below which scaling activities are notallowed to shrink. Scale-in activities will not terminate instances below this boundary.
Type: Integer
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31198
Amazon Elastic MapReduce API ReferenceScalingRule
ScalingRuleA scale-in or scale-out rule that defines scaling activity, including the CloudWatch metric alarm thattriggers activity, how EC2 instances are added or removed, and the periodicity of adjustments. Theautomatic scaling policy for an instance group can comprise one or more automatic scaling rules.
ContentsAction
The conditions that trigger an automatic scaling activity.
Type: ScalingAction (p. 197) object
Required: YesDescription
A friendly, more verbose description of the automatic scaling rule.
Type: String
Required: NoName
The name used to identify an automatic scaling rule. Rule names must be unique within a scalingpolicy.
Type: String
Required: YesTrigger
The CloudWatch alarm definition that determines when automatic scaling activity is triggered.
Type: ScalingTrigger (p. 200) object
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31199
Amazon Elastic MapReduce API ReferenceScalingTrigger
ScalingTriggerThe conditions that trigger an automatic scaling activity.
ContentsCloudWatchAlarmDefinition
The definition of a CloudWatch metric alarm. When the defined alarm conditions are met along withother trigger parameters, scaling activity begins.
Type: CloudWatchAlarmDefinition (p. 116) object
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31200
Amazon Elastic MapReduce API ReferenceScriptBootstrapActionConfig
ScriptBootstrapActionConfigConfiguration of the script to run during a bootstrap action.
ContentsArgs
A list of command line arguments to pass to the bootstrap action script.
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoPath
Location of the script to run during a bootstrap action. Can be either a location in Amazon S3 or on alocal file system.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31201
Amazon Elastic MapReduce API ReferenceSecurityConfigurationSummary
SecurityConfigurationSummaryThe creation date and time, and name, of a security configuration.
ContentsCreationDateTime
The date and time the security configuration was created.
Type: Timestamp
Required: NoName
The name of the security configuration.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31202
Amazon Elastic MapReduce API ReferenceShrinkPolicy
ShrinkPolicyPolicy for customizing shrink operations. Allows configuration of decommissioning timeout and targetedinstance shrinking.
ContentsDecommissionTimeout
The desired timeout for decommissioning an instance. Overrides the default YARN decommissioningtimeout.
Type: Integer
Required: NoInstanceResizePolicy
Custom policy for requesting termination protection or termination of specific instances whenshrinking an instance group.
Type: InstanceResizePolicy (p. 169) object
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31203
Amazon Elastic MapReduce API ReferenceSimpleScalingPolicyConfiguration
SimpleScalingPolicyConfigurationAn automatic scaling configuration, which describes how the policy adds or removes instances, thecooldown period, and the number of EC2 instances that will be added each time the CloudWatch metricalarm condition is satisfied.
ContentsAdjustmentType
The way in which EC2 instances are added (if ScalingAdjustment is a positive number) orterminated (if ScalingAdjustment is a negative number) each time the scaling activity istriggered. CHANGE_IN_CAPACITY is the default. CHANGE_IN_CAPACITY indicates that the EC2instance count increments or decrements by ScalingAdjustment, which should be expressed asan integer. PERCENT_CHANGE_IN_CAPACITY indicates the instance count increments or decrementsby the percentage specified by ScalingAdjustment, which should be expressed as an integer.For example, 20 indicates an increase in 20% increments of cluster capacity. EXACT_CAPACITYindicates the scaling activity results in an instance group with the number of EC2 instances specifiedby ScalingAdjustment, which should be expressed as a positive integer.
Type: String
Valid Values: CHANGE_IN_CAPACITY | PERCENT_CHANGE_IN_CAPACITY | EXACT_CAPACITY
Required: NoCoolDown
The amount of time, in seconds, after a scaling activity completes before any further trigger-relatedscaling activities can start. The default value is 0.
Type: Integer
Required: NoScalingAdjustment
The amount by which to scale in or scale out, based on the specified AdjustmentType. A positivevalue adds to the instance group's EC2 instance count while a negative number removes instances.If AdjustmentType is set to EXACT_CAPACITY, the number should only be a positive integer.If AdjustmentType is set to PERCENT_CHANGE_IN_CAPACITY, the value should express thepercentage as an integer. For example, -20 indicates a decrease in 20% increments of clustercapacity.
Type: Integer
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31204
Amazon Elastic MapReduce API ReferenceSee Also
API Version 2009-03-31205
Amazon Elastic MapReduce API ReferenceSpotProvisioningSpecification
SpotProvisioningSpecificationThe launch specification for Spot instances in the instance fleet, which determines the defined durationand provisioning timeout behavior.
NoteThe instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later,excluding 5.0.x versions.
ContentsBlockDurationMinutes
The defined duration for Spot instances (also known as Spot blocks) in minutes. When specified, theSpot instance does not terminate before the defined duration expires, and defined duration pricingfor Spot instances applies. Valid values are 60, 120, 180, 240, 300, or 360. The duration period startsas soon as a Spot instance receives its instance ID. At the end of the duration, Amazon EC2 marksthe Spot instance for termination and provides a Spot instance termination notice, which gives theinstance a two-minute warning before it terminates.
Type: Integer
Valid Range: Minimum value of 0.
Required: NoTimeoutAction
The action to take when TargetSpotCapacity has not been fulfilled when theTimeoutDurationMinutes has expired; that is, when all Spot instances could not beprovisioned within the Spot provisioning timeout. Valid values are TERMINATE_CLUSTER andSWITCH_TO_ON_DEMAND. SWITCH_TO_ON_DEMAND specifies that if no Spot instances are available,On-Demand Instances should be provisioned to fulfill any remaining Spot capacity.
Type: String
Valid Values: SWITCH_TO_ON_DEMAND | TERMINATE_CLUSTER
Required: YesTimeoutDurationMinutes
The spot provisioning timeout period in minutes. If Spot instances are not provisioned within thistime period, the TimeOutAction is taken. Minimum value is 5 and maximum value is 1440. Thetimeout applies only during initial provisioning, when the cluster is first created.
Type: Integer
Valid Range: Minimum value of 0.
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go
API Version 2009-03-31206
Amazon Elastic MapReduce API ReferenceSee Also
• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31207
Amazon Elastic MapReduce API ReferenceStep
StepThis represents a step in a cluster.
ContentsActionOnFailure
The action to take when the cluster step fails. Possible values are TERMINATE_CLUSTER,CANCEL_AND_WAIT, and CONTINUE. TERMINATE_JOB_FLOW is provided for backward compatibility.We recommend using TERMINATE_CLUSTER instead.
Type: String
Valid Values: TERMINATE_JOB_FLOW | TERMINATE_CLUSTER | CANCEL_AND_WAIT |CONTINUE
Required: NoConfig
The Hadoop job configuration of the cluster step.
Type: HadoopStepConfig (p. 142) object
Required: NoId
The identifier of the cluster step.
Type: String
Required: NoName
The name of the cluster step.
Type: String
Required: NoStatus
The current execution status details of the cluster step.
Type: StepStatus (p. 215) object
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31208
Amazon Elastic MapReduce API ReferenceSee Also
API Version 2009-03-31209
Amazon Elastic MapReduce API ReferenceStepConfig
StepConfigSpecification of a cluster (job flow) step.
ContentsActionOnFailure
The action to take when the cluster step fails. Possible values are TERMINATE_CLUSTER,CANCEL_AND_WAIT, and CONTINUE. TERMINATE_JOB_FLOW is provided for backward compatibility.We recommend using TERMINATE_CLUSTER instead.
Type: String
Valid Values: TERMINATE_JOB_FLOW | TERMINATE_CLUSTER | CANCEL_AND_WAIT |CONTINUE
Required: NoHadoopJarStep
The JAR file used for the step.
Type: HadoopJarStepConfig (p. 140) object
Required: YesName
The name of the step.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31210
Amazon Elastic MapReduce API ReferenceStepDetail
StepDetailCombines the execution state and configuration of a step.
ContentsExecutionStatusDetail
The description of the step status.
Type: StepExecutionStatusDetail (p. 212) object
Required: YesStepConfig
The step configuration.
Type: StepConfig (p. 210) object
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31211
Amazon Elastic MapReduce API ReferenceStepExecutionStatusDetail
StepExecutionStatusDetailThe execution state of a step.
ContentsCreationDateTime
The creation date and time of the step.
Type: Timestamp
Required: YesEndDateTime
The completion date and time of the step.
Type: Timestamp
Required: NoLastStateChangeReason
A description of the step's current state.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoStartDateTime
The start date and time of the step.
Type: Timestamp
Required: NoState
The state of the step.
Type: String
Valid Values: PENDING | RUNNING | CONTINUE | COMPLETED | CANCELLED | FAILED |INTERRUPTED
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java
API Version 2009-03-31212
Amazon Elastic MapReduce API ReferenceSee Also
• AWS SDK for Ruby V3
API Version 2009-03-31213
Amazon Elastic MapReduce API ReferenceStepStateChangeReason
StepStateChangeReasonThe details of the step state change reason.
ContentsCode
The programmable code for the state change reason. Note: Currently, the service provides no codefor the state change.
Type: String
Valid Values: NONE
Required: NoMessage
The descriptive message for the state change reason.
Type: String
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31214
Amazon Elastic MapReduce API ReferenceStepStatus
StepStatusThe execution status details of the cluster step.
ContentsFailureDetails
The details for the step failure including reason, message, and log file path where the root cause wasidentified.
Type: FailureDetails (p. 139) object
Required: NoState
The execution state of the cluster step.
Type: String
Valid Values: PENDING | CANCEL_PENDING | RUNNING | COMPLETED | CANCELLED |FAILED | INTERRUPTED
Required: NoStateChangeReason
The reason for the step execution status change.
Type: StepStateChangeReason (p. 214) object
Required: NoTimeline
The timeline of the cluster step status over time.
Type: StepTimeline (p. 218) object
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31215
Amazon Elastic MapReduce API ReferenceStepSummary
StepSummaryThe summary of the cluster step.
ContentsActionOnFailure
The action to take when the cluster step fails. Possible values are TERMINATE_CLUSTER,CANCEL_AND_WAIT, and CONTINUE. TERMINATE_JOB_FLOW is available for backward compatibility.We recommend using TERMINATE_CLUSTER instead.
Type: String
Valid Values: TERMINATE_JOB_FLOW | TERMINATE_CLUSTER | CANCEL_AND_WAIT |CONTINUE
Required: NoConfig
The Hadoop job configuration of the cluster step.
Type: HadoopStepConfig (p. 142) object
Required: NoId
The identifier of the cluster step.
Type: String
Required: NoName
The name of the cluster step.
Type: String
Required: NoStatus
The current execution status details of the cluster step.
Type: StepStatus (p. 215) object
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31216
Amazon Elastic MapReduce API ReferenceSee Also
API Version 2009-03-31217
Amazon Elastic MapReduce API ReferenceStepTimeline
StepTimelineThe timeline of the cluster step lifecycle.
ContentsCreationDateTime
The date and time when the cluster step was created.
Type: Timestamp
Required: NoEndDateTime
The date and time when the cluster step execution completed or failed.
Type: Timestamp
Required: NoStartDateTime
The date and time when the cluster step execution started.
Type: Timestamp
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31218
Amazon Elastic MapReduce API ReferenceSupportedProductConfig
SupportedProductConfigThe list of supported product configurations which allow user-supplied arguments. EMR accepts thesearguments and forwards them to the corresponding installation script as bootstrap action arguments.
ContentsArgs
The list of user-supplied arguments.
Type: Array of strings
Length Constraints: Minimum length of 0. Maximum length of 10280.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: NoName
The name of the product configuration.
Type: String
Length Constraints: Minimum length of 0. Maximum length of 256.
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31219
Amazon Elastic MapReduce API ReferenceTag
TagA key/value pair containing user-defined metadata that you can associate with an Amazon EMR resource.Tags make it easier to associate clusters in various ways, such as grouping clusters to track your AmazonEMR resource allocation costs. For more information, see Tag Clusters.
ContentsKey
A user-defined key, which is the minimum required information for a valid tag. For moreinformation, see Tag .
Type: String
Required: NoValue
A user-defined value, which is optional in a tag. For more information, see Tag Clusters.
Type: String
Required: No
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31220
Amazon Elastic MapReduce API ReferenceVolumeSpecification
VolumeSpecificationEBS volume specifications such as volume type, IOPS, and size (GiB) that will be requested for the EBSvolume attached to an EC2 instance in the cluster.
ContentsIops
The number of I/O operations per second (IOPS) that the volume supports.
Type: Integer
Required: NoSizeInGB
The volume size, in gibibytes (GiB). This can be a number from 1 - 1024. If the volume type is EBS-optimized, the minimum value is 10.
Type: Integer
Required: YesVolumeType
The volume type. Volume types supported are gp2, io1, standard.
Type: String
Required: Yes
See AlsoFor more information about using this API in one of the language-specific AWS SDKs, see the following:
• AWS SDK for C++• AWS SDK for Go• AWS SDK for Java• AWS SDK for Ruby V3
API Version 2009-03-31221
Amazon Elastic MapReduce API Reference
Common ParametersThe following list contains the parameters that all actions use for signing Signature Version 4 requestswith a query string. Any action-specific parameters are listed in the topic for that action. For moreinformation about Signature Version 4, see Signature Version 4 Signing Process in the Amazon WebServices General Reference.
Action
The action to be performed.
Type: string
Required: YesVersion
The API version that the request is written for, expressed in the format YYYY-MM-DD.
Type: string
Required: YesX-Amz-Algorithm
The hash algorithm that you used to create the request signature.
Condition: Specify this parameter when you include authentication information in a query stringinstead of in the HTTP authorization header.
Type: string
Valid Values: AWS4-HMAC-SHA256
Required: ConditionalX-Amz-Credential
The credential scope value, which is a string that includes your access key, the date, the region youare targeting, the service you are requesting, and a termination string ("aws4_request"). The value isexpressed in the following format: access_key/YYYYMMDD/region/service/aws4_request.
For more information, see Task 2: Create a String to Sign for Signature Version 4 in the Amazon WebServices General Reference.
Condition: Specify this parameter when you include authentication information in a query stringinstead of in the HTTP authorization header.
Type: string
Required: ConditionalX-Amz-Date
The date that is used to create the signature. The format must be ISO 8601 basic format(YYYYMMDD'T'HHMMSS'Z'). For example, the following date time is a valid X-Amz-Date value:20120325T120000Z.
Condition: X-Amz-Date is optional for all requests; it can be used to override the date used forsigning requests. If the Date header is specified in the ISO 8601 basic format, X-Amz-Date is
API Version 2009-03-31222
Amazon Elastic MapReduce API Reference
not required. When X-Amz-Date is used, it always overrides the value of the Date header. Formore information, see Handling Dates in Signature Version 4 in the Amazon Web Services GeneralReference.
Type: string
Required: ConditionalX-Amz-Security-Token
The temporary security token that was obtained through a call to AWS Security Token Service (AWSSTS). For a list of services that support temporary security credentials from AWS Security TokenService, go to AWS Services That Work with IAM in the IAM User Guide.
Condition: If you're using temporary security credentials from the AWS Security Token Service, youmust include the security token.
Type: string
Required: ConditionalX-Amz-Signature
Specifies the hex-encoded signature that was calculated from the string to sign and the derivedsigning key.
Condition: Specify this parameter when you include authentication information in a query stringinstead of in the HTTP authorization header.
Type: string
Required: ConditionalX-Amz-SignedHeaders
Specifies all the HTTP headers that were included as part of the canonical request. For moreinformation about specifying signed headers, see Task 1: Create a Canonical Request For SignatureVersion 4 in the Amazon Web Services General Reference.
Condition: Specify this parameter when you include authentication information in a query stringinstead of in the HTTP authorization header.
Type: string
Required: Conditional
API Version 2009-03-31223
Amazon Elastic MapReduce API Reference
Common ErrorsThis section lists the errors common to the API actions of all AWS services. For errors specific to an APIaction for this service, see the topic for that API action.
AccessDeniedException
You do not have sufficient access to perform this action.
HTTP Status Code: 400IncompleteSignature
The request signature does not conform to AWS standards.
HTTP Status Code: 400InternalFailure
The request processing has failed because of an unknown error, exception or failure.
HTTP Status Code: 500InvalidAction
The action or operation requested is invalid. Verify that the action is typed correctly.
HTTP Status Code: 400InvalidClientTokenId
The X.509 certificate or AWS access key ID provided does not exist in our records.
HTTP Status Code: 403InvalidParameterCombination
Parameters that must not be used together were used together.
HTTP Status Code: 400InvalidParameterValue
An invalid or out-of-range value was supplied for the input parameter.
HTTP Status Code: 400InvalidQueryParameter
The AWS query string is malformed or does not adhere to AWS standards.
HTTP Status Code: 400MalformedQueryString
The query string contains a syntax error.
HTTP Status Code: 404MissingAction
The request is missing an action or a required parameter.
HTTP Status Code: 400
API Version 2009-03-31224
Amazon Elastic MapReduce API Reference
MissingAuthenticationToken
The request must contain either a valid (registered) AWS access key ID or X.509 certificate.
HTTP Status Code: 403MissingParameter
A required parameter for the specified action is not supplied.
HTTP Status Code: 400OptInRequired
The AWS access key ID needs a subscription for the service.
HTTP Status Code: 403RequestExpired
The request reached the service more than 15 minutes after the date stamp on the request or morethan 15 minutes after the request expiration date (such as for pre-signed URLs), or the date stampon the request is more than 15 minutes in the future.
HTTP Status Code: 400ServiceUnavailable
The request has failed due to a temporary failure of the server.
HTTP Status Code: 503ThrottlingException
The request was denied due to request throttling.
HTTP Status Code: 400ValidationError
The input fails to satisfy the constraints specified by an AWS service.
HTTP Status Code: 400
API Version 2009-03-31225