Table below describes where each configuration option is read.
Analysis conducted at Mon May 30 16:00:48 2011 on: 

 Hadoop 0.20.2-cdh3u0
Subversion  -r 81256ad0f2e4ab2bd34b04f53d25a6c23686dd14
Compiled by hudson on Fri Mar 25 19:56:23 PDT 2011
From source with checksum 6c1f62dddc4eac69b6b973c18bbc0f55

Total of 502 options found. 301 have values in *-defaults.xml.

Notes:

Option nameDescriptionDefaultInDaemonPosition
$HADOOP_CLIENT_OPTS TaskTrackero.a.h.mapred.TaskRunner.getVMEnvironment:569
$HADOOP_HOME TaskTrackero.a.h.mapred.LinuxTaskController.setConf:76
$HADOOP_TOKEN_FILE_LOCATION TaskTrackero.a.h.security.UserGroupInformation.getLoginUser:490
DFSAdmino.a.h.security.UserGroupInformation.getLoginUser:490
DataNodeo.a.h.security.UserGroupInformation.getLoginUser:490
FS_Shello.a.h.security.UserGroupInformation.getLoginUser:490
JobCliento.a.h.security.UserGroupInformation.getLoginUser:490
JobTrackero.a.h.security.UserGroupInformation.getLoginUser:490
NameNodeo.a.h.security.UserGroupInformation.getLoginUser:490
SecondaryNNo.a.h.security.UserGroupInformation.getLoginUser:490
TT_Childo.a.h.security.UserGroupInformation.getLoginUser:490
$KRB5CCNAME TaskTrackero.a.h.security.UserGroupInformation$HadoopConfiguration.:370
DFSAdmino.a.h.security.UserGroupInformation$HadoopConfiguration.:370
DataNodeo.a.h.security.UserGroupInformation$HadoopConfiguration.:370
FS_Shello.a.h.security.UserGroupInformation$HadoopConfiguration.:370
JobCliento.a.h.security.UserGroupInformation$HadoopConfiguration.:370
JobTrackero.a.h.security.UserGroupInformation$HadoopConfiguration.:370
NameNodeo.a.h.security.UserGroupInformation$HadoopConfiguration.:370
SecondaryNNo.a.h.security.UserGroupInformation$HadoopConfiguration.:370
TT_Childo.a.h.security.UserGroupInformation$HadoopConfiguration.:370
$LD_LIBRARY_PATH TaskTrackero.a.h.mapred.TaskRunner.getVMEnvironment:556
CONF-(chain.reducer|chain.mapper)(.reducer.config|.mapper.config.) TT_Childo.a.h.mapred.lib.Chain.getChainElementConf:127
CONF-(chain.reducer|chain.mapper).mapper.class..* TT_Childo.a.h.mapred.lib.Chain.configure:326
CONF-(chain.reducer|chain.mapper).mapper.config..* TT_Childo.a.h.mapred.lib.Chain.configure:328
CONF-(chain.reducer|chain.mapper).reducer.class TT_Childo.a.h.mapred.lib.Chain.configure:343
CONF-(chain.reducer|chain.mapper).reducer.config TT_Childo.a.h.mapred.lib.Chain.configure:346
CONF-(chain.reducer|chain.mapper).size ('0 ' is default in code) TT_Childo.a.h.mapred.lib.Chain.configure:324
CONF-aggregate.max.num.unique.values ('9223372036854775807 ' is default in code) TT_Childo.a.h.mapred.lib.aggregate.ValueAggregatorBaseDescriptor.configure:157
CONF-aggregator.descriptor..* TT_Childo.a.h.mapred.lib.aggregate.ValueAggregatorJobBase.getAggregatorDescriptors:64
CONF-aggregator.descriptor.num ('0 ' is default in code) TT_Childo.a.h.mapred.lib.aggregate.ValueAggregatorJobBase.getAggregatorDescriptors:61
CONF-chain.mapper.byValue ('1 ' is default in code) TT_Childo.a.h.mapred.lib.Chain.configure:333
CONF-chain.mapper.output.key.class TT_Childo.a.h.mapred.lib.Chain.configure:334
CONF-chain.mapper.output.value.class TT_Childo.a.h.mapred.lib.Chain.configure:336
CONF-chain.reducer.byValue ('1 ' is default in code) TT_Childo.a.h.mapred.lib.Chain.configure:349
CONF-chain.reducer.output.key.class TT_Childo.a.h.mapred.lib.Chain.configure:350
CONF-chain.reducer.output.value.class TT_Childo.a.h.mapred.lib.Chain.configure:352
CONF-dfs.access.time.precision The access time for HDFS file is precise upto this value. The default value is 1 hour. Setting a value of 0 disables access times for HDFS. 3600000 ('0 ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:485
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:485
CONF-dfs.balance.bandwidthPerSec Specifies the maximum amount of bandwidth that each datanode can utilize for the balancing purpose in term of the number of bytes per second. 1048576 ('1048576 ' is default in code) hdfs-default.xml DataNodeo.a.h.hdfs.server.datanode.DataXceiverServer.<init>:121
CONF-dfs.block.access.key.update.interval Interval in minutes at which namenode updates its access keys. 600 ('600 ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:490
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:490
CONF-dfs.block.access.token.enable If "true", access tokens are used as capabilities for accessing datanodes. If "false", no access tokens are checked on accessing datanodes. false ('0 ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:487
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:487
CONF-dfs.block.access.token.lifetime The lifetime of access tokens in minutes. 600 ('600 ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:492
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:492
CONF-dfs.block.invalidate.limit SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:481
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:481
CONF-dfs.block.size The default block size for new files. 67108864 ('67108864 ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:474
DFSAdmino.a.h.hdfs.DFSClient.<init>:209
DataNodeo.a.h.hdfs.server.datanode.DataXceiverServer.<init>:118
FS_Shello.a.h.hdfs.DFSClient.<init>:209
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:474
CONF-dfs.blockreport.initialDelay Delay for first block report in seconds. 0 ('0 ' is default in code) hdfs-default.xml DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:411
CONF-dfs.blockreport.intervalMsec Determines block reporting interval in milliseconds. 3600000 ('3600000 ' is default in code) hdfs-default.xml DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:409
CONF-dfs.client.block.recovery.retries ('5 ' is default in code) FS_Shello.a.h.hdfs.DFSClient$DFSOutputStream.processDatanodeError:2807
CONF-dfs.client.block.write.locateFollowingBlock.retries ('5 ' is default in code) FS_Shello.a.h.hdfs.DFSClient$DFSOutputStream.locateFollowingBlock:3178
CONF-dfs.client.block.write.retries The number of retries for writing blocks to the data nodes, before we signal failure to the application. 3 ('3 ' is default in code) hdfs-default.xml FS_Shello.a.h.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream:3042
CONF-dfs.client.max.block.acquire.failures ('3 ' is default in code) FS_Shello.a.h.hdfs.DFSClient.getMaxBlockAcquireFailures:226
DFSAdmino.a.h.hdfs.DFSClient.getMaxBlockAcquireFailures:226
CONF-dfs.cluster.administrators (' ' is default in code) DataNodeo.a.h.security.SecurityUtil.getAdminAcls:271
DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:439
DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:439
CONF-dfs.data.dir Determines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored. ${hadoop.tmp.dir}/dfs/data hdfs-default.xml DataNodeo.a.h.hdfs.server.datanode.DataNode.instantiateDataNode:1470
CONF-dfs.datanode.address The address where the datanode server will listen to. If the port is 0 then the server will start on a free port. 0.0.0.0:50010 hdfs-default.xml DataNodeo.a.h.net.NetUtils.getServerAddress:185
DataNodeo.a.h.hdfs.server.datanode.DataNode.getStreamingAddr:1950
CONF-dfs.datanode.artificialBlockReceivedDelay ('0 ' is default in code) DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:381
CONF-dfs.datanode.bindAddress dfs.datanode.bindAddress docs/changes.html DataNodeo.a.h.net.NetUtils.getServerAddress:183
DataNodeo.a.h.hdfs.server.datanode.DataNode.getStreamingAddr:1950
CONF-dfs.datanode.data.dir.perm Permissions for the directories on on the local filesystem where the DFS data node store its blocks. The permissions can either be octal or symbolic. 700 ('700 ' is default in code) hdfs-default.xml DataNodeo.a.h.hdfs.server.datanode.DataNode.makeInstance:1520
CONF-dfs.datanode.dns.interface The name of the Network Interface from which a data node should report its IP address. default ('default ' is default in code) hdfs-default.xml TaskTrackero.a.h.metrics.ganglia.GangliaContext31.init:59
DFSAdmino.a.h.metrics.ganglia.GangliaContext31.init:59
DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:321
DataNodeo.a.h.metrics.ganglia.GangliaContext31.init:59
FS_Shello.a.h.metrics.ganglia.GangliaContext31.init:59
JobCliento.a.h.metrics.ganglia.GangliaContext31.init:59
JobTrackero.a.h.metrics.ganglia.GangliaContext31.init:59
NameNodeo.a.h.metrics.ganglia.GangliaContext31.init:59
SecondaryNNo.a.h.metrics.ganglia.GangliaContext31.init:59
TT_Childo.a.h.metrics.ganglia.GangliaContext31.init:59
CONF-dfs.datanode.dns.nameserver The host name or IP address of the name server (DNS) which a DataNode should use to determine the host name used by the NameNode for communication and display purposes. default ('default ' is default in code) hdfs-default.xml TaskTrackero.a.h.metrics.ganglia.GangliaContext31.init:59
DFSAdmino.a.h.metrics.ganglia.GangliaContext31.init:59
DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:321
DataNodeo.a.h.metrics.ganglia.GangliaContext31.init:59
FS_Shello.a.h.metrics.ganglia.GangliaContext31.init:59
JobCliento.a.h.metrics.ganglia.GangliaContext31.init:59
JobTrackero.a.h.metrics.ganglia.GangliaContext31.init:59
NameNodeo.a.h.metrics.ganglia.GangliaContext31.init:59
SecondaryNNo.a.h.metrics.ganglia.GangliaContext31.init:59
TT_Childo.a.h.metrics.ganglia.GangliaContext31.init:59
CONF-dfs.datanode.du.reserved Reserved space in bytes per volume. Always leave this much space free for non dfs use. 0 ('0 ' is default in code) hdfs-default.xml DataNodeo.a.h.hdfs.server.datanode.FSDataset$FSVolume.<init>:359
CONF-dfs.datanode.failed.volumes.tolerated The number of volumes that are allowed to fail before a datanode stops offering service. By default any volume failure will cause a datanode to shutdown. 0 ('0 ' is default in code) hdfs-default.xml DataNodeo.a.h.hdfs.server.datanode.FSDataset.<init>:890
CONF-dfs.datanode.handler.count The number of server threads for the datanode. 3 ('3 ' is default in code) hdfs-default.xml DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:473
CONF-dfs.datanode.http.address The datanode http server address and port. If the port is 0 then the server will start on a free port. 0.0.0.0:50075 hdfs-default.xml DataNodeo.a.h.net.NetUtils.getServerAddress:185
DataNodeo.a.h.hdfs.server.datanode.DataNode.getInfoAddr:513
CONF-dfs.datanode.https.address 0.0.0.0:50475 hdfs-default.xml DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:447
CONF-dfs.datanode.info.bindAddress DataNodeo.a.h.net.NetUtils.getServerAddress:183
DataNodeo.a.h.hdfs.server.datanode.DataNode.getInfoAddr:513
CONF-dfs.datanode.info.port dfs.datanode.info.port docs/changes.html DataNodeo.a.h.net.NetUtils.getServerAddress:184
DataNodeo.a.h.hdfs.server.datanode.DataNode.getInfoAddr:513
CONF-dfs.datanode.ipc.address The datanode ipc server address and port. If the port is 0 then the server will start on a free port. 0.0.0.0:50020 hdfs-default.xml DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:471
CONF-dfs.datanode.kerberos.principal DataNodeo.a.h.security.SecurityUtil.login:230
CONF-dfs.datanode.keytab.file DataNodeo.a.h.security.SecurityUtil.login:222
CONF-dfs.datanode.max.xcievers ('256 ' is default in code) DataNodeo.a.h.hdfs.server.datanode.DataXceiverServer.<init>:115
CONF-dfs.datanode.numblocks ('64 ' is default in code) DataNodeo.a.h.hdfs.server.datanode.FSDataset.<init>:887
CONF-dfs.datanode.plugins Comma-separated list of datanode plug-ins to be activated. hdfs-default.xml DataNodeo.a.h.util.PluginDispatcher.createFromConfiguration:59
DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:487
CONF-dfs.datanode.port dfs.datanode.port docs/changes.html DataNodeo.a.h.net.NetUtils.getServerAddress:184
DataNodeo.a.h.hdfs.server.datanode.DataNode.getStreamingAddr:1950
CONF-dfs.datanode.require.secure.ports ('1 ' is default in code) DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:304
CONF-dfs.datanode.scan.period.hours ('0 ' is default in code) DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:423
DataNodeo.a.h.hdfs.server.datanode.DataBlockScanner.<init>:140
CONF-dfs.datanode.simulateddatastorage ('0 ' is default in code) DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:354
CONF-dfs.datanode.socket.write.timeout ('480000 ' is default in code) FS_Shello.a.h.hdfs.DFSClient.<init>:194
DFSAdmino.a.h.hdfs.DFSClient.<init>:194
DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:329
CONF-dfs.datanode.startup Set internally by DataNode o.a.h.hdfs.server.datanode.DataNode.setStartupOption:1580 DataNodeo.a.h.hdfs.server.datanode.DataNode.getStartupOption:1584
CONF-dfs.datanode.transferTo.allowed ('1 ' is default in code) DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:333
CONF-dfs.default.chunk.view.size The number of bytes to view for a file on the browser. 32768 ('32768 ' is default in code) hdfs-default.xml NameNodeo.a.h.hdfs.server.namenode.JspHelper.getDefaultChunkSize:499
CONF-dfs.df.interval Disk usage statistics refresh interval in msec. 60000 ('3000 ' is default in code) hdfs-default.xml TaskTrackero.a.h.fs.DF.<init>:45
DataNodeo.a.h.fs.DF.<init>:45
CONF-dfs.heartbeat.interval Determines datanode heartbeat interval in seconds. 3 ('3 ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:467
DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:418
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:467
CONF-dfs.hosts Names a file that contains a list of hosts that are permitted to connect to the namenode. The full pathname of the file must be specified. If the value is empty, all hosts are permitted. (' ' is default in code) hdfs-default.xml NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.refreshNodes:4273
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.initialize:369
CONF-dfs.hosts.exclude Names a file that contains a list of hosts that are not permitted to connect to the namenode. The full pathname of the file must be specified. If the value is empty, no hosts are excluded. (' ' is default in code) hdfs-default.xml NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.refreshNodes:4273
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.initialize:369
CONF-dfs.http.address The address and the base port where the dfs namenode web ui will listen on. If the port is 0 then the server will start on a free port. 0.0.0.0:50070 hdfs-default.xml SecondaryNNo.a.h.net.NetUtils.getServerAddress:185
NameNodeo.a.h.hdfs.server.namenode.NameNode.getInfoServer:328
NameNodeo.a.h.hdfs.server.namenode.NameNode.startHttpServer:334
NameNodeo.a.h.net.NetUtils.getServerAddress:185
SecondaryNNo.a.h.hdfs.server.namenode.NameNode.getInfoServer:328
CONF-dfs.https.address 0.0.0.0:50470 hdfs-default.xml SecondaryNNo.a.h.net.NetUtils.getServerAddress:185
NameNodeo.a.h.hdfs.server.namenode.NameNode.getInfoServer:328
NameNodeo.a.h.net.NetUtils.getServerAddress:185
SecondaryNNo.a.h.hdfs.server.namenode.NameNode.getInfoServer:328
CONF-dfs.https.client.keystore.resource Resource file from which ssl client keystore information will be extracted ssl-client.xml ('ssl-client.xml ' is default in code) hdfs-default.xml FS_Shello.a.h.hdfs.HsftpFileSystem.setupSsl:49
DFSAdmino.a.h.hdfs.HsftpFileSystem.setupSsl:49
CONF-dfs.https.enable Decide if HTTPS(SSL) is supported on HDFS false ('0 ' is default in code) hdfs-default.xml DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:445
CONF-dfs.https.need.client.auth Whether SSL client certificate authentication is required false ('0 ' is default in code) hdfs-default.xml DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:446
CONF-dfs.https.port ('50470 ' is default in code) FS_Shello.a.h.hdfs.HftpFileSystem.initialize:129
DFSAdmino.a.h.hdfs.HftpFileSystem.initialize:129
CONF-dfs.https.server.keystore.resource Resource file from which ssl server keystore information will be extracted ssl-server.xml ('ssl-server.xml ' is default in code) hdfs-default.xml DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:450
CONF-dfs.info.bindAddress dfs.info.bindAddress docs/changes.html SecondaryNNo.a.h.net.NetUtils.getServerAddress:183
NameNodeo.a.h.hdfs.server.namenode.NameNode.getInfoServer:328
NameNodeo.a.h.hdfs.server.namenode.NameNode.startHttpServer:334
NameNodeo.a.h.net.NetUtils.getServerAddress:183
SecondaryNNo.a.h.hdfs.server.namenode.NameNode.getInfoServer:328
CONF-dfs.info.port dfs.info.port docs/changes.html SecondaryNNo.a.h.net.NetUtils.getServerAddress:184
NameNodeo.a.h.hdfs.server.namenode.NameNode.getInfoServer:328
NameNodeo.a.h.hdfs.server.namenode.NameNode.startHttpServer:334
NameNodeo.a.h.net.NetUtils.getServerAddress:184
SecondaryNNo.a.h.hdfs.server.namenode.NameNode.getInfoServer:328
CONF-dfs.ls.limit ('1000 ' is default in code) SecondaryNNo.a.h.hdfs.server.namenode.FSDirectory.<init>:76
NameNodeo.a.h.hdfs.server.namenode.FSDirectory.<init>:76
CONF-dfs.max-repl-streams ('2 ' is default in code) SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:466
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:466
CONF-dfs.max.objects The maximum number of files, directories and blocks dfs supports. A value of zero indicates no limit to the number of objects that dfs supports. 0 ('0 ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:475
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:475
CONF-dfs.name.dir Determines where on the local filesystem the DFS name node should store the name table(fsimage). If this is a comma-delimited list of directories then the name table is replicated in all of the directories, for redundancy. ${hadoop.tmp.dir}/dfs/name hdfs-default.xml NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.getNamespaceDirs:394
CONF-dfs.name.dir.restore ('0 ' is default in code) NameNodeo.a.h.hdfs.server.namenode.FSDirectory.<init>:62
CONF-dfs.name.edits.dir Determines where on the local filesystem the DFS name node should store the transaction (edits) file. If this is a comma-delimited list of directories then the transaction file is replicated in all of the directories, for redundancy. Default value is same as dfs.name.dir ${dfs.name.dir} hdfs-default.xml NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.getNamespaceEditsDirs:405
CONF-dfs.namenode.decommission.interval Namenode periodicity in seconds to check if decommission is complete. 30 ('30 ' is default in code) hdfs-default.xml NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.initialize:371
CONF-dfs.namenode.decommission.nodes.per.interval The number of nodes namenode checks if decommission is complete in each dfs.namenode.decommission.interval. 5 ('5 ' is default in code) hdfs-default.xml NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.initialize:371
CONF-dfs.namenode.delegation.key.update-interval The update interval for master key for delegation tokens in the namenode in milliseconds. 86400000 ('86400000 ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.createDelegationTokenSecretManager:5255
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.createDelegationTokenSecretManager:5255
CONF-dfs.namenode.delegation.token.max-lifetime The maximum lifetime in milliseconds for which a delegation token is valid. 604800000 ('604800000 ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.createDelegationTokenSecretManager:5255
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.createDelegationTokenSecretManager:5255
CONF-dfs.namenode.delegation.token.renew-interval The renewal interval for delegation token in milliseconds. 86400000 ('86400000 ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.createDelegationTokenSecretManager:5255
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.createDelegationTokenSecretManager:5255
CONF-dfs.namenode.handler.count The number of server threads for the namenode. 10 ('10 ' is default in code) hdfs-default.xml NameNodeo.a.h.hdfs.server.namenode.NameNode.initialize:264
CONF-dfs.namenode.kerberos.https.principal NameNodeo.a.h.security.SecurityUtil.login:230
NameNodeo.a.h.hdfs.server.namenode.NameNode.startHttpServer:338
NameNodeo.a.h.hdfs.server.namenode.NameNode.startHttpServer:423
NameNodeo.a.h.hdfs.server.namenode.NameNode.startHttpServer:423
CONF-dfs.namenode.kerberos.principal (' ' is default in code) NameNodeo.a.h.security.SecurityUtil.login:230
DFSAdmino.a.h.hdfs.tools.DFSAdmin.refreshServiceAcl:638
DFSAdmino.a.h.hdfs.tools.DFSAdmin.refreshSuperUserGroupsConfiguration:700
DFSAdmino.a.h.hdfs.tools.DFSAdmin.refreshUserToGroupsMappings:670
NameNodeo.a.h.hdfs.server.namenode.NameNode.startHttpServer:342
NameNodeo.a.h.hdfs.server.namenode.NameNode.startHttpServer:426
NameNodeo.a.h.hdfs.server.namenode.NameNode.startHttpServer:426
CONF-dfs.namenode.keytab.file NameNodeo.a.h.security.SecurityUtil.login:222
CONF-dfs.namenode.plugins Comma-separated list of namenode plug-ins to be activated. hdfs-default.xml NameNodeo.a.h.util.PluginDispatcher.createFromConfiguration:59
NameNodeo.a.h.hdfs.server.namenode.NameNode.initialize:313
CONF-dfs.namenode.service.handler.count ('10 ' is default in code) NameNodeo.a.h.hdfs.server.namenode.NameNode.initialize:276
CONF-dfs.namenode.servicerpc-address Set internally by NameNode o.a.h.hdfs.server.namenode.NameNode.setServiceAddress:191 SecondaryNNo.a.h.hdfs.server.namenode.NameNode.getServiceAddress:203
DataNodeo.a.h.hdfs.server.namenode.NameNode.getServiceAddress:203
NameNodeo.a.h.hdfs.server.namenode.NameNode.getServiceAddress:203
CONF-dfs.namenode.startup Set internally by NameNode o.a.h.hdfs.server.namenode.NameNode.setStartupOption:1180 NameNodeo.a.h.hdfs.server.namenode.NameNode.getStartupOption:1184
CONF-dfs.network.script through configuration variable <span class="codefrag">dfs.network.script</span>. When this docs/hdfs_user_guide.html DataNodeo.a.h.hdfs.server.datanode.DataNode.instantiateDataNode:1465
CONF-dfs.permissions If "true", enable permission checking in HDFS. If "false", permission checking is turned off, but all other behavior is unchanged. Switching from one parameter value to the other does not change the mode, owner or group of files or directories. true ('1 ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:436
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:436
CONF-dfs.permissions.supergroup The name of the group of super-users. supergroup ('supergroup ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:435
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:435
CONF-dfs.read.prefetch.size FS_Shello.a.h.hdfs.DFSClient$DFSInputStream.<init>:1592
DFSAdmino.a.h.hdfs.DFSClient$DFSInputStream.<init>:1592
CONF-dfs.replication Default block replication. The actual number of replications can be specified when the file is created. The default is used if replication is not specified in create time. 3 ('3 ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:448
DFSAdmino.a.h.hdfs.DFSClient.<init>:210
FS_Shello.a.h.hdfs.DFSClient.<init>:210
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:448
CONF-dfs.replication.considerLoad Decide if chooseTarget considers the target's load or not true ('1 ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:444
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:444
CONF-dfs.replication.interval The periodicity in seconds with which the namenode computes repliaction work for datanodes. 3 ('3 ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:472
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:472
CONF-dfs.replication.max Maximal block replication. 512 ('512 ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:449
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:449
CONF-dfs.replication.min Minimal block replication. 1 ('1 ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:450
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem$SafeModeInfo.<init>:4457
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:450
CONF-dfs.replication.pending.timeout.sec ('-1 ' is default in code) NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.initialize:355
CONF-dfs.safemode.extension Determines extension of safe mode in milliseconds after the threshold level is reached. 30000 ('0 ' is default in code) hdfs-default.xml NameNodeo.a.h.hdfs.server.namenode.FSNamesystem$SafeModeInfo.<init>:4456
CONF-dfs.safemode.min.datanodes Specifies the number of datanodes that must be considered alive before the name node exits safemode. Values less than or equal to 0 mean not to take the number of live datanodes into account when deciding whether to remain in safe mode during startup. Values greater than the number of datanodes in the cluster will make safe mode permanent. 0 ('0 ' is default in code) hdfs-default.xml NameNodeo.a.h.hdfs.server.namenode.FSNamesystem$SafeModeInfo.<init>:4455
CONF-dfs.safemode.threshold.pct Specifies the percentage of blocks that should satisfy the minimal replication requirement defined by dfs.replication.min. Values less than or equal to 0 mean not to wait for any particular percentage of blocks before exiting safemode. Values greater than 1 will make safe mode permanent. 0.999f ('0.95 ' is default in code) hdfs-default.xml NameNodeo.a.h.hdfs.server.namenode.FSNamesystem$SafeModeInfo.<init>:4454
CONF-dfs.secondary.http.address The secondary namenode http server address and port. If the port is 0 then the server will start on a free port. 0.0.0.0:50090 hdfs-default.xml SecondaryNNo.a.h.net.NetUtils.getServerAddress:185
SecondaryNNo.a.h.hdfs.server.namenode.SecondaryNameNode.getHttpAddress:139
CONF-dfs.secondary.info.bindAddress dfs.secondary.info.bindAddress docs/changes.html SecondaryNNo.a.h.net.NetUtils.getServerAddress:183
SecondaryNNo.a.h.hdfs.server.namenode.SecondaryNameNode.getHttpAddress:139
CONF-dfs.secondary.info.port dfs.secondary.info.port docs/changes.html SecondaryNNo.a.h.net.NetUtils.getServerAddress:184
SecondaryNNo.a.h.hdfs.server.namenode.SecondaryNameNode.getHttpAddress:139
CONF-dfs.secondary.namenode.kerberos.https.principal SecondaryNNo.a.h.hdfs.server.namenode.SecondaryNameNode.initialize:184
CONF-dfs.secondary.namenode.kerberos.principal SecondaryNNo.a.h.security.SecurityUtil.login:230
CONF-dfs.secondary.namenode.keytab.file SecondaryNNo.a.h.security.SecurityUtil.login:222
SecondaryNNo.a.h.hdfs.server.namenode.SecondaryNameNode.initialize:184
CONF-dfs.socket.timeout ('60000 ' is default in code) FS_Shello.a.h.hdfs.DFSClient.<init>:192
DFSAdmino.a.h.hdfs.DFSClient.<init>:192
DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:327
CONF-dfs.support.append Does HDFS allow appends to files? true ('0 ' is default in code) hdfs-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:486
DataNodeo.a.h.hdfs.server.datanode.FSDataset$FSVolume.<init>:362
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:486
CONF-dfs.umask dfs.umask to set the umask that is used by DFS. /Users/asrabkin/Documents/cloudera/hadoop-0.20.2-cdh3u0/docs/hdfs_permissions_guide.html:<span class="codefrag">dfs.umask = 022</span> ('-2147483648 ' is default in code) docs/changes.html FS_Shello.a.h.fs.permission.FsPermission.getUMask:218
CONF-dfs.umaskmode FS_Shello.a.h.fs.permission.FsPermission.getUMask:225
CONF-dfs.upgrade.permission <span class="codefrag">dfs.upgrade.permission = 0777</span> ('511 ' is default in code) docs/hdfs_permissions_guide.html SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:439
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:439
CONF-dfs.web.ugi The user account used by the web interface. Syntax: USERNAME,GROUP1,GROUP2, ... webuser webgroup hdfs-default.xml NameNodeo.a.h.hdfs.server.namenode.JspHelper.getDefaultWebUser:409
CONF-dfs.write.packet.size ('65536 ' is default in code) FS_Shello.a.h.hdfs.DFSClient.<init>:198
DFSAdmino.a.h.hdfs.DFSClient.<init>:198
DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:335
CONF-fs..*.impl TaskTrackero.a.h.fs.FileSystem.createFileSystem:1508
DFSAdmino.a.h.fs.FileSystem.createFileSystem:1508
DataNodeo.a.h.fs.FileSystem.createFileSystem:1508
FS_Shello.a.h.fs.FileSystem.createFileSystem:1508
JobCliento.a.h.fs.FileSystem.createFileSystem:1508
JobTrackero.a.h.fs.FileSystem.createFileSystem:1508
NameNodeo.a.h.fs.FileSystem.createFileSystem:1508
SecondaryNNo.a.h.fs.FileSystem.createFileSystem:1508
TT_Childo.a.h.fs.FileSystem.createFileSystem:1508
CONF-fs.automatic.close By default, FileSystem instances are automatically closed at program exit using a JVM shutdown hook. Setting this property to false disables this behavior. This is an advanced option that should only be used by server applications requiring a more carefully orchestrated shutdown sequence. true ('1 ' is default in code) core-default.xml TaskTrackero.a.h.fs.FileSystem$Cache.getInternal:1563
DFSAdmino.a.h.fs.FileSystem$Cache.getInternal:1563
DataNodeo.a.h.fs.FileSystem$Cache.getInternal:1563
FS_Shello.a.h.fs.FileSystem$Cache.getInternal:1563
JobCliento.a.h.fs.FileSystem$Cache.getInternal:1563
JobTrackero.a.h.fs.FileSystem$Cache.getInternal:1563
NameNodeo.a.h.fs.FileSystem$Cache.getInternal:1563
SecondaryNNo.a.h.fs.FileSystem$Cache.getInternal:1563
TT_Childo.a.h.fs.FileSystem$Cache.getInternal:1563
CONF-fs.checkpoint.dir Determines where on the local filesystem the DFS secondary name node should store the temporary images to merge. If this is a comma-delimited list of directories then the image is replicated in all of the directories for redundancy. ${hadoop.tmp.dir}/dfs/namesecondary core-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSImage.getCheckpointDirs:1749
NameNodeo.a.h.hdfs.server.namenode.FSImage.getCheckpointDirs:1749
CONF-fs.checkpoint.edits.dir Determines where on the local filesystem the DFS secondary name node should store the temporary edits to merge. If this is a comma-delimited list of directoires then teh edits is replicated in all of the directoires for redundancy. Default value is same as fs.checkpoint.dir ${fs.checkpoint.dir} core-default.xml SecondaryNNo.a.h.hdfs.server.namenode.FSImage.getCheckpointEditsDirs:1762
NameNodeo.a.h.hdfs.server.namenode.FSImage.getCheckpointEditsDirs:1762
CONF-fs.checkpoint.period The number of seconds between two periodic checkpoints. 3600 ('3600 ' is default in code) core-default.xml SecondaryNNo.a.h.hdfs.server.namenode.SecondaryNameNode.initialize:179
CONF-fs.checkpoint.size The size of the current edit log (in bytes) that triggers a periodic checkpoint even if the fs.checkpoint.period hasn't expired. 67108864 ('4194304 ' is default in code) core-default.xml SecondaryNNo.a.h.hdfs.server.namenode.SecondaryNameNode.initialize:180
CONF-fs.default.name The name of the default file system. A URI whose scheme and authority determine the FileSystem implementation. The uri's scheme determines the config property (fs.SCHEME.impl) naming the FileSystem implementation class. The uri's authority is used to determine the host, port, etc. for a filesystem. file:/// ('file:/// ' is default in code) core-default.xml TaskTrackero.a.h.fs.FileSystem.getDefaultUri:119
DFSAdmino.a.h.fs.FileSystem.getDefaultUri:119
DataNodeo.a.h.fs.FileSystem.getDefaultUri:119
FS_Shello.a.h.fs.FileSystem.getDefaultUri:119
JobCliento.a.h.fs.FileSystem.getDefaultUri:119
JobTrackero.a.h.fs.FileSystem.getDefaultUri:119
NameNodeo.a.h.fs.FileSystem.getDefaultUri:119
SecondaryNNo.a.h.fs.FileSystem.getDefaultUri:119
TT_Childo.a.h.fs.FileSystem.getDefaultUri:119
CONF-fs.ftp.host Set internally by DFSAdmin o.a.h.fs.ftp.FTPFileSystem.initialize:66 FS_Shello.a.h.fs.ftp.FTPFileSystem.initialize:62
DFSAdmino.a.h.fs.ftp.FTPFileSystem.connect:102
DFSAdmino.a.h.fs.ftp.FTPFileSystem.initialize:62
FS_Shello.a.h.fs.ftp.FTPFileSystem.connect:102
CONF-fs.ftp.host.port Set internally by DFSAdmin o.a.h.fs.ftp.FTPFileSystem.initialize:71 ('21 ' is default in code) FS_Shello.a.h.fs.ftp.FTPFileSystem.connect:103
DFSAdmino.a.h.fs.ftp.FTPFileSystem.connect:103
CONF-fs.ftp.password..* Set internally by DFSAdmin o.a.h.fs.ftp.FTPFileSystem.initialize:87 FS_Shello.a.h.fs.ftp.FTPFileSystem.initialize:76
DFSAdmino.a.h.fs.ftp.FTPFileSystem.connect:105
DFSAdmino.a.h.fs.ftp.FTPFileSystem.initialize:76
FS_Shello.a.h.fs.ftp.FTPFileSystem.connect:105
CONF-fs.ftp.user..* Set internally by DFSAdmin o.a.h.fs.ftp.FTPFileSystem.initialize:83 FS_Shello.a.h.fs.ftp.FTPFileSystem.initialize:76
DFSAdmino.a.h.fs.ftp.FTPFileSystem.connect:104
DFSAdmino.a.h.fs.ftp.FTPFileSystem.initialize:76
FS_Shello.a.h.fs.ftp.FTPFileSystem.connect:104
CONF-fs.inmemory.size.mb ('100 ' is default in code) FS_Shello.a.h.fs.InMemoryFileSystem$RawInMemoryFileSystem.initialize:68
DFSAdmino.a.h.fs.InMemoryFileSystem$RawInMemoryFileSystem.initialize:68
CONF-fs.kfs.metaServerHost (' ' is default in code) FS_Shello.a.h.fs.kfs.KosmosFileSystem.initialize:66
DFSAdmino.a.h.fs.kfs.KosmosFileSystem.initialize:66
CONF-fs.kfs.metaServerPort ('-1 ' is default in code) FS_Shello.a.h.fs.kfs.KosmosFileSystem.initialize:66
DFSAdmino.a.h.fs.kfs.KosmosFileSystem.initialize:66
CONF-fs.local.block.size ('33554432 ' is default in code) TT_Childo.a.h.fs.FileSystem.getDefaultBlockSize:1382
DFSAdmino.a.h.fs.FileSystem.getDefaultBlockSize:1382
FS_Shello.a.h.fs.FileSystem.getDefaultBlockSize:1382
JobTrackero.a.h.fs.FileSystem.getDefaultBlockSize:1382
CONF-fs.s3.block.size Block size to use when writing files to S3. 67108864 ('67108864 ' is default in code) core-default.xml FS_Shello.a.h.fs.s3.S3FileSystem.getDefaultBlockSize:341
DFSAdmino.a.h.fs.s3.S3FileSystem.getDefaultBlockSize:341
CONF-fs.s3.buffer.dir Determines where on the local filesystem the S3 filesystem should store files before sending them to S3 (or after retrieving them from S3). ${hadoop.tmp.dir}/s3 core-default.xml FS_Shello.a.h.fs.s3native.NativeS3FileSystem$NativeS3FsOutputStream.newBackupFile:192
FS_Shello.a.h.fs.s3.S3OutputStream.newBackupFile:82
CONF-fs.s3.maxRetries The maximum number of retries for reading or writing files to S3, before we signal failure to the application. 4 ('4 ' is default in code) core-default.xml FS_Shello.a.h.fs.s3native.NativeS3FileSystem.createDefaultStore:267
DFSAdmino.a.h.fs.s3.S3FileSystem.createDefaultStore:87
DFSAdmino.a.h.fs.s3native.NativeS3FileSystem.createDefaultStore:267
FS_Shello.a.h.fs.s3.S3FileSystem.createDefaultStore:87
CONF-fs.s3.sleepTimeSeconds The number of seconds to sleep between each S3 retry. 10 ('10 ' is default in code) core-default.xml FS_Shello.a.h.fs.s3native.NativeS3FileSystem.createDefaultStore:267
DFSAdmino.a.h.fs.s3.S3FileSystem.createDefaultStore:87
DFSAdmino.a.h.fs.s3native.NativeS3FileSystem.createDefaultStore:267
FS_Shello.a.h.fs.s3.S3FileSystem.createDefaultStore:87
CONF-fs.s3n.block.size Block size to use when reading files using the native S3 filesystem (s3n: URIs). 67108864 ('67108864 ' is default in code) core-default.xml FS_Shello.a.h.fs.s3native.NativeS3FileSystem.getDefaultBlockSize:639
DFSAdmino.a.h.fs.s3native.NativeS3FileSystem.getDefaultBlockSize:639
CONF-fs.trash.interval Number of minutes between trash checkpoints. If zero, the trash feature is disabled. 0 ('60 ' is default in code) core-default.xml NameNodeo.a.h.fs.Trash.<init>:81
DFSAdmino.a.h.fs.Trash.<init>:73
FS_Shello.a.h.fs.Trash.<init>:73
NameNodeo.a.h.fs.Trash$Emptier.<init>:222
NameNodeo.a.h.fs.Trash.<init>:73
CONF-hadoop.http.filter.initializers A comma separated list of class names. Each class in the list must extend org.apache.hadoop.http.FilterInitializer. The corresponding Filter will be initialized. Then, the Filter will be applied to all user facing jsp and servlet web pages. The ordering of the list defines the ordering of the filters. core-default.xml TaskTrackero.a.h.http.HttpServer.getFilterInitializers:216
DataNodeo.a.h.http.HttpServer.getFilterInitializers:216
JobTrackero.a.h.http.HttpServer.getFilterInitializers:216
CONF-hadoop.job.history.location If job tracker is static the history files are stored in this single well known place. If No value is set here, by default, it is in the local file system at ${hadoop.log.dir}/history. mapred-default.xml JobTrackerdynamic
CONF-hadoop.job.history.user.location User can specify a location to store the history files of a particular job. If nothing is specified, the logs are stored in output directory. The files are stored in "_logs/history/" in the directory. User can stop logging by giving the value "none". mapred-default.xml JobTrackero.a.h.mapred.JobHistory$JobInfo.getJobHistoryLogLocationForUser:853
CONF-hadoop.kerberos.kinit.command ('/usr/kerberos/bin/kinit ' is default in code) TaskTrackero.a.h.security.UserGroupInformation$1.run:551
DFSAdmino.a.h.security.UserGroupInformation$1.run:551
DataNodeo.a.h.security.UserGroupInformation$1.run:551
FS_Shello.a.h.security.UserGroupInformation$1.run:551
JobCliento.a.h.security.UserGroupInformation$1.run:551
JobTrackero.a.h.security.UserGroupInformation$1.run:551
NameNodeo.a.h.security.UserGroupInformation$1.run:551
SecondaryNNo.a.h.security.UserGroupInformation$1.run:551
TT_Childo.a.h.security.UserGroupInformation$1.run:551
CONF-hadoop.native.lib Should native hadoop libraries, if present, be used. true ('1 ' is default in code) core-default.xml TT_Childo.a.h.io.compress.zlib.ZlibFactory.isNativeZlibLoaded:63
FS_Shello.a.h.io.compress.zlib.ZlibFactory.isNativeZlibLoaded:63
CONF-hadoop.net.static.resolutions TaskTrackero.a.h.mapred.Task.setConf:995
DataNodeo.a.h.mapred.Task.setConf:995
FS_Shello.a.h.mapred.Task.setConf:995
JobTrackero.a.h.mapred.Task.setConf:995
NameNodeo.a.h.mapred.Task.setConf:995
TT_Childo.a.h.mapred.Task.setConf:995
CONF-hadoop.pipes.executable TaskTrackero.a.h.mapred.pipes.Submitter.getExecutable:85
CONF-hadoop.pipes.partitioner TT_Childo.a.h.mapred.pipes.Submitter.getJavaPartitioner:198
CONF-hadoop.rpc.protection TaskTrackero.a.h.security.SaslRpcServer.init:77
DFSAdmino.a.h.security.SaslRpcServer.init:77
DataNodeo.a.h.security.SaslRpcServer.init:77
FS_Shello.a.h.security.SaslRpcServer.init:77
JobCliento.a.h.security.SaslRpcServer.init:77
JobTrackero.a.h.security.SaslRpcServer.init:77
NameNodeo.a.h.security.SaslRpcServer.init:77
SecondaryNNo.a.h.security.SaslRpcServer.init:77
CONF-hadoop.rpc.socket.factory.class..* <td><a name="hadoop.rpc.socket.factory.class.default">hadoop.rpc.socket.factory.class.default</a></td><td>org.apache.hadoop.net.StandardSocketFactory</td><td> Default SocketFactory to use. This parameter is expected to be /Users/asrabkin/Documents/cloudera/hadoop-0.20.2-cdh3u0/docs/mapred-default.html:<td><a name="hadoop.rpc.socket.factory.class.JobSubmissionProtocol">hadoop.rpc.socket.factory.class.JobSubmissionProtocol</a></td><td></td><td> SocketFactory to use to connect to a Map/Reduce master docs/core-default.html JobTrackero.a.h.net.NetUtils.getSocketFactory:68
DFSAdmino.a.h.net.NetUtils.getSocketFactory:68
FS_Shello.a.h.net.NetUtils.getSocketFactory:68
JobCliento.a.h.net.NetUtils.getSocketFactory:68
CONF-hadoop.rpc.socket.factory.class.default Default SocketFactory to use. This parameter is expected to be formatted as "package.FactoryClassName". org.apache.hadoop.net.StandardSocketFactory core-default.xml SecondaryNNo.a.h.net.NetUtils.getDefaultSocketFactory:90
DFSAdmino.a.h.net.NetUtils.getDefaultSocketFactory:90
DataNodeo.a.h.net.NetUtils.getDefaultSocketFactory:90
FS_Shello.a.h.net.NetUtils.getDefaultSocketFactory:90
JobCliento.a.h.net.NetUtils.getDefaultSocketFactory:90
JobTrackero.a.h.net.NetUtils.getDefaultSocketFactory:90
CONF-hadoop.security.auth_to_local ('DEFAULT ' is default in code) TaskTrackero.a.h.security.KerberosName.setConfiguration:342
DFSAdmino.a.h.security.KerberosName.setConfiguration:342
DataNodeo.a.h.security.KerberosName.setConfiguration:342
FS_Shello.a.h.security.KerberosName.setConfiguration:342
JobCliento.a.h.security.KerberosName.setConfiguration:342
JobTrackero.a.h.security.KerberosName.setConfiguration:342
NameNodeo.a.h.security.KerberosName.setConfiguration:342
SecondaryNNo.a.h.security.KerberosName.setConfiguration:342
TT_Childo.a.h.security.KerberosName.setConfiguration:342
CONF-hadoop.security.authentication Possible values are simple (no authentication), and kerberos simple core-default.xml TaskTrackero.a.h.security.UserGroupInformation.initialize:210
DFSAdmino.a.h.security.UserGroupInformation.initialize:210
DataNodeo.a.h.security.UserGroupInformation.initialize:210
FS_Shello.a.h.security.UserGroupInformation.initialize:210
JobCliento.a.h.security.UserGroupInformation.initialize:210
JobTrackero.a.h.security.UserGroupInformation.initialize:210
NameNodeo.a.h.security.UserGroupInformation.initialize:210
SecondaryNNo.a.h.security.UserGroupInformation.initialize:210
TT_Childo.a.h.security.UserGroupInformation.initialize:210
CONF-hadoop.security.authorization Is service-level authorization enabled? false ('0 ' is default in code) core-default.xml TaskTrackero.a.h.mapred.TaskTracker.initialize:786
DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:478
DataNodeo.a.h.ipc.Server.<init>:1505
JobTrackero.a.h.ipc.Server.<init>:1505
JobTrackero.a.h.mapred.JobTracker.<init>:2141
JobTrackero.a.h.mapred.JobTracker.refreshServiceAcl:4851
NameNodeo.a.h.hdfs.server.namenode.NameNode.initialize:290
NameNodeo.a.h.ipc.Server.<init>:1505
TaskTrackero.a.h.ipc.Server.<init>:1505
CONF-hadoop.security.authorization.policyprovider TaskTrackero.a.h.mapred.TaskTracker.initialize:788
CONF-hadoop.security.group.mapping Class for user to group mapping (get groups for a given user) org.apache.hadoop.security.ShellBasedUnixGroupsMapping core-default.xml TaskTrackero.a.h.security.Groups.<init>:48
DFSAdmino.a.h.security.Groups.<init>:48
DataNodeo.a.h.security.Groups.<init>:48
FS_Shello.a.h.security.Groups.<init>:48
JobCliento.a.h.security.Groups.<init>:48
JobTrackero.a.h.security.Groups.<init>:48
NameNodeo.a.h.security.Groups.<init>:48
SecondaryNNo.a.h.security.Groups.<init>:48
TT_Childo.a.h.security.Groups.<init>:48
CONF-hadoop.security.groups.cache.secs ('300 ' is default in code) TaskTrackero.a.h.security.Groups.<init>:55
DFSAdmino.a.h.security.Groups.<init>:55
DataNodeo.a.h.security.Groups.<init>:55
FS_Shello.a.h.security.Groups.<init>:55
JobCliento.a.h.security.Groups.<init>:55
JobTrackero.a.h.security.Groups.<init>:55
NameNodeo.a.h.security.Groups.<init>:55
SecondaryNNo.a.h.security.Groups.<init>:55
TT_Childo.a.h.security.Groups.<init>:55
CONF-hadoop.workaround.non.threadsafe.getpwuid Some operating systems or authentication modules are known to have broken implementations of getpwuid_r and getpwgid_r, such that these calls are not thread-safe. Symptoms of this problem include JVM crashes with a stack trace inside these functions. If your system exhibits this issue, enable this configuration parameter to include a lock around the calls as a workaround. An incomplete list of some systems known to have this issue is available at http://wiki.apache.org/hadoop/KnownBrokenPwuidImplementations false ('0 ' is default in code) core-default.xml TaskTrackero.a.h.io.nativeio.NativeIO.:64
FS_Shello.a.h.io.nativeio.NativeIO.:64
TT_Childo.a.h.io.nativeio.NativeIO.:64
CONF-hdfs.service.host_ (' ' is default in code) FS_Shello.a.h.hdfs.HftpFileSystem.initialize:136
DFSAdmino.a.h.hdfs.HftpFileSystem.initialize:134
DFSAdmino.a.h.hdfs.HftpFileSystem.initialize:136
FS_Shello.a.h.hdfs.HftpFileSystem.initialize:134
CONF-heartbeat.recheck.interval ('300000 ' is default in code) SecondaryNNo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:468
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.setConfigurationParameters:468
CONF-io.bytes.per.checksum The number of bytes per checksum. Must not be larger than io.file.buffer.size. 512 ('512 ' is default in code) core-default.xml TT_Childo.a.h.io.SequenceFile$Reader.handleChecksumException:2157
DFSAdmino.a.h.fs.ChecksumFileSystem.setConf:56
FS_Shello.a.h.fs.ChecksumFileSystem.setConf:56
FS_Shello.a.h.hdfs.DFSClient.create:544
TT_Childo.a.h.fs.ChecksumFileSystem.setConf:56
CONF-io.compression.codecs A list of the compression codec classes that can be used for compression/decompression. org.apache.hadoop.io.compress.DefaultCodec org.apache.hadoop.io.compress.GzipCodec org.apache.hadoop.io.compress.BZip2Codec core-default.xml TT_Childo.a.h.io.compress.CompressionCodecFactory.getCodecClasses:80
FS_Shello.a.h.io.compress.CompressionCodecFactory.getCodecClasses:80
JobTrackero.a.h.io.compress.CompressionCodecFactory.getCodecClasses:80
CONF-io.file.buffer.size The size of buffer for use in sequence files. The size of this buffer should probably be a multiple of hardware page size (4096 on Intel x86), and it determines how much data is buffered during read and write operations. 4096 ('4096 ' is default in code) core-default.xml TaskTrackero.a.h.io.IOUtils.copyBytes:87
DFSAdmino.a.h.fs.ChecksumFileSystem.getSumBufferSize:96
DFSAdmino.a.h.fs.FileSystem.open:456
DFSAdmino.a.h.fs.s3.Jets3tFileSystemStore.initialize:96
DFSAdmino.a.h.util.LineReader.<init>:75
DataNodeo.a.h.fs.FileSystem.open:456
FS_Shello.a.h.fs.ChecksumFileSystem.getSumBufferSize:96
FS_Shello.a.h.fs.FileSystem.create:472
FS_Shello.a.h.fs.FileSystem.open:456
FS_Shello.a.h.fs.s3.Jets3tFileSystemStore.initialize:96
FS_Shello.a.h.io.IOUtils.copyBytes:74
FS_Shello.a.h.io.IOUtils.copyBytes:87
FS_Shello.a.h.io.SequenceFile$Reader.<init>:1419
FS_Shello.a.h.io.compress.DefaultCodec.createInputStream:64
FS_Shello.a.h.io.compress.DefaultCodec.createInputStream:71
FS_Shello.a.h.io.compress.GzipCodec.createInputStream:173
FS_Shello.a.h.io.compress.GzipCodec.createInputStream:183
FS_Shello.a.h.util.LineReader.<init>:75
JobCliento.a.h.fs.FileSystem.open:456
JobTrackero.a.h.fs.FileSystem.create:472
JobTrackero.a.h.fs.FileSystem.open:456
JobTrackero.a.h.io.IOUtils.copyBytes:87
NameNodeo.a.h.fs.FileSystem.open:456
TT_Childo.a.h.fs.ChecksumFileSystem.getSumBufferSize:96
TT_Childo.a.h.fs.FileSystem.create:472
TT_Childo.a.h.fs.FileSystem.open:456
TT_Childo.a.h.io.IOUtils.copyBytes:87
TT_Childo.a.h.io.SequenceFile$Reader.<init>:1419
TT_Childo.a.h.io.compress.DefaultCodec.createInputStream:71
TT_Childo.a.h.io.compress.GzipCodec.createInputStream:173
TT_Childo.a.h.io.compress.GzipCodec.createInputStream:183
TaskTrackero.a.h.fs.FileSystem.create:472
TaskTrackero.a.h.fs.FileSystem.open:456
CONF-io.serializations A list of serialization classes that can be used for obtaining serializers and deserializers. org.apache.hadoop.io.serializer.WritableSerialization core-default.xml TaskTrackero.a.h.io.serializer.SerializationFactory.<init>:52
DataNodeo.a.h.io.serializer.SerializationFactory.<init>:52
FS_Shello.a.h.io.serializer.SerializationFactory.<init>:52
JobTrackero.a.h.io.serializer.SerializationFactory.<init>:52
NameNodeo.a.h.io.serializer.SerializationFactory.<init>:52
TT_Childo.a.h.io.serializer.SerializationFactory.<init>:52
CONF-io.skip.checksum.errors If true, when a checksum error is encountered while reading a sequence file, entries are skipped, instead of throwing an exception. false ('0 ' is default in code) core-default.xml TT_Childo.a.h.io.SequenceFile$Reader.handleChecksumException:2155
CONF-io.sort.factor The number of streams to merge at once while sorting files. This determines the number of open file handles. 10 mapred-default.xml TT_Childdynamic
CONF-io.sort.mb The total amount of buffer memory to use while sorting files, in megabytes. By default, gives each merge stream 1MB, which should minimize seeks. 100 mapred-default.xml TT_Childdynamic
CONF-io.sort.record.percent The percentage of io.sort.mb dedicated to tracking record boundaries. Let this value be r, io.sort.mb be x. The maximum number of records collected before the collection thread must block is equal to (r * x) / 4 0.05 mapred-default.xml TT_Childdynamic
CONF-io.sort.spill.percent The soft limit in either the buffer or record collection buffers. Once reached, a thread will begin to spill the contents to disk in the background. Note that this does not imply any chunking of data to the spill. A value less than 0.5 is not recommended. 0.80 mapred-default.xml TT_Childdynamic
CONF-ipc.client.connect.max.retries Indicates the number of retries a client will make to establish a server connection. 10 ('10 ' is default in code) core-default.xml SecondaryNNo.a.h.ipc.Client$ConnectionId.getConnectionId:1329
DFSAdmino.a.h.ipc.Client$ConnectionId.getConnectionId:1329
DataNodeo.a.h.ipc.Client$ConnectionId.getConnectionId:1329
FS_Shello.a.h.ipc.Client$ConnectionId.getConnectionId:1329
JobCliento.a.h.ipc.Client$ConnectionId.getConnectionId:1329
JobTrackero.a.h.ipc.Client$ConnectionId.getConnectionId:1329
CONF-ipc.client.connection.maxidletime The maximum time in msec after which a client will bring down the connection to the server. 10000 ('1000 ' is default in code) core-default.xml TaskTrackero.a.h.ipc.Server.<init>:1501
DFSAdmino.a.h.ipc.Client$ConnectionId.getConnectionId:1329
DataNodeo.a.h.ipc.Client$ConnectionId.getConnectionId:1329
DataNodeo.a.h.ipc.Server.<init>:1501
FS_Shello.a.h.ipc.Client$ConnectionId.getConnectionId:1329
JobCliento.a.h.ipc.Client$ConnectionId.getConnectionId:1329
JobTrackero.a.h.ipc.Client$ConnectionId.getConnectionId:1329
JobTrackero.a.h.ipc.Server.<init>:1501
NameNodeo.a.h.ipc.Server.<init>:1501
SecondaryNNo.a.h.ipc.Client$ConnectionId.getConnectionId:1329
CONF-ipc.client.idlethreshold Defines the threshold number of connections after which connections will be inspected for idleness. 4000 ('4000 ' is default in code) core-default.xml TaskTrackero.a.h.ipc.Server.<init>:1503
DataNodeo.a.h.ipc.Server.<init>:1503
JobTrackero.a.h.ipc.Server.<init>:1503
NameNodeo.a.h.ipc.Server.<init>:1503
CONF-ipc.client.kill.max Defines the maximum number of clients to disconnect in one go. 10 ('10 ' is default in code) core-default.xml TaskTrackero.a.h.ipc.Server.<init>:1502
DataNodeo.a.h.ipc.Server.<init>:1502
JobTrackero.a.h.ipc.Server.<init>:1502
NameNodeo.a.h.ipc.Server.<init>:1502
CONF-ipc.client.ping ('1 ' is default in code) SecondaryNNo.a.h.ipc.Client$ConnectionId.getConnectionId:1328
DFSAdmino.a.h.ipc.Client$ConnectionId.getConnectionId:1328
DataNodeo.a.h.ipc.Client$ConnectionId.getConnectionId:1328
FS_Shello.a.h.ipc.Client$ConnectionId.getConnectionId:1328
JobCliento.a.h.ipc.Client$ConnectionId.getConnectionId:1328
JobTrackero.a.h.ipc.Client$ConnectionId.getConnectionId:1328
CONF-ipc.client.tcpnodelay Turn on/off Nagle's algorithm for the TCP socket connection on the client. Setting to true disables the algorithm and may decrease latency with a cost of more/smaller packets. false ('0 ' is default in code) core-default.xml SecondaryNNo.a.h.ipc.Client$ConnectionId.getConnectionId:1329
DFSAdmino.a.h.ipc.Client$ConnectionId.getConnectionId:1329
DataNodeo.a.h.ipc.Client$ConnectionId.getConnectionId:1329
FS_Shello.a.h.ipc.Client$ConnectionId.getConnectionId:1329
JobCliento.a.h.ipc.Client$ConnectionId.getConnectionId:1329
JobTrackero.a.h.ipc.Client$ConnectionId.getConnectionId:1329
CONF-ipc.ping.interval ('60000 ' is default in code) SecondaryNNo.a.h.ipc.Client.getPingInterval:136
DFSAdmino.a.h.ipc.Client.getPingInterval:136
DataNodeo.a.h.ipc.Client.getPingInterval:136
FS_Shello.a.h.ipc.Client.getPingInterval:136
JobCliento.a.h.ipc.Client.getPingInterval:136
JobTrackero.a.h.ipc.Client.getPingInterval:136
CONF-ipc.server.handler.queue.size ('100 ' is default in code) TaskTrackero.a.h.ipc.Server.<init>:1492
DataNodeo.a.h.ipc.Server.<init>:1492
JobTrackero.a.h.ipc.Server.<init>:1492
NameNodeo.a.h.ipc.Server.<init>:1492
CONF-ipc.server.listen.queue.size Indicates the length of the listen queue for servers accepting client connections. 128 ('128 ' is default in code) core-default.xml TaskTrackero.a.h.ipc.Server$Listener.<init>:310
DataNodeo.a.h.ipc.Server$Listener.<init>:310
JobTrackero.a.h.ipc.Server$Listener.<init>:310
NameNodeo.a.h.ipc.Server$Listener.<init>:310
CONF-ipc.server.max.response.size ('1048576 ' is default in code) TaskTrackero.a.h.ipc.Server.<init>:1495
DataNodeo.a.h.ipc.Server.<init>:1495
JobTrackero.a.h.ipc.Server.<init>:1495
NameNodeo.a.h.ipc.Server.<init>:1495
CONF-ipc.server.read.threadpool.size ('1 ' is default in code) TaskTrackero.a.h.ipc.Server.<init>:1497
DataNodeo.a.h.ipc.Server.<init>:1497
JobTrackero.a.h.ipc.Server.<init>:1497
NameNodeo.a.h.ipc.Server.<init>:1497
CONF-ipc.server.tcpnodelay Turn on/off Nagle's algorithm for the TCP socket connection on the server. Setting to true disables the algorithm and may decrease latency with a cost of more/smaller packets. false ('0 ' is default in code) core-default.xml TaskTrackero.a.h.ipc.Server.<init>:1516
DataNodeo.a.h.ipc.Server.<init>:1516
JobTrackero.a.h.ipc.Server.<init>:1516
NameNodeo.a.h.ipc.Server.<init>:1516
CONF-job.end.notification.url completion. If the job configuration has a job.end.notification.url docs/changes.html JobTrackero.a.h.mapred.JobConf.getJobEndNotificationURI:1644
CONF-job.end.retry.attempts Indicates how many times hadoop should attempt to contact the notification URL 0 ('0 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobEndNotifier.createNotification:101
CONF-job.end.retry.interval Indicates time in milliseconds between notification URL retry calls 30000 ('30000 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobEndNotifier.createNotification:102
CONF-job.local.dir <span class="codefrag">job.local.dir</span>. The directory can accessed through docs/mapred_tutorial.html JobTrackero.a.h.mapred.JobConf.getJobLocalDir:1683
CONF-jobTracker/.*.xml JobTrackero.a.h.mapred.JobInProgress.<init>:408
CONF-jobclient.completion.poll.interval The interval (in milliseconds) between which the JobClient polls the JobTracker for updates about job status. You may want to set this to a lower value to make tests run faster on a single node system. Adjusting this value in production may lead to unwanted client-server traffic. 5000 ('5000 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobClient$NetworkedJob.<init>:226
JobCliento.a.h.mapred.JobClient$NetworkedJob.<init>:226
CONF-jobclient.output.filter The filter for controlling the output of the task's userlogs sent to the console of the JobClient. The permissible options are: NONE, KILLED, FAILED, SUCCEEDED and ALL. FAILED ('FAILED ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobClient.getTaskOutputFilter:1465
CONF-jobclient.progress.monitor.poll.interval The interval (in milliseconds) between which the JobClient reports status to the console and checks for job completion. You may want to set this to a lower value to make tests run faster on a single node system. Adjusting this value in production may lead to unwanted client-server traffic. 1000 ('1000 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobClient.init:490
JobCliento.a.h.mapred.JobClient.init:490
CONF-keep.failed.task.files Should the files for failed tasks be kept. This should only be used on jobs that are failing, because the storage is never reclaimed. It also prevents the map outputs from being erased from the reduce directory as they are consumed. false ('0 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.JobConf.getKeepFailedTaskFiles:517
JobTrackero.a.h.mapred.JobConf.getKeepFailedTaskFiles:517
CONF-keep.task.files.pattern (also see <span class="codefrag">keep.task.files.pattern</span>).</p> docs/mapred_tutorial.html TaskTrackero.a.h.mapred.JobConf.getKeepTaskFilesPattern:539
JobTrackero.a.h.mapred.JobConf.getKeepTaskFilesPattern:539
CONF-local.cache.size The number of bytes to allocate in each local TaskTracker directory for holding Distributed Cache data. 10737418240 ('10737418240 ' is default in code) mapred-default.xml TaskTrackero.a.h.filecache.TrackerDistributedCacheManager.<init>:114
CONF-map.input.file <td colspan="1" rowspan="1">map.input.file</td><td colspan="1" rowspan="1"> String</td> docs/mapred_tutorial.html TT_Childo.a.h.mapred.lib.aggregate.ValueAggregatorBaseDescriptor.configure:156
CONF-map.output.key.field.separator -D map.output.key.field.separator=. \ ('' is default in code) docs/streaming.html TT_Childo.a.h.mapred.lib.KeyFieldBasedPartitioner.configure:51
TT_Childo.a.h.mapred.lib.KeyFieldBasedComparator.configure:55
CONF-map.output.key.value.fields.spec -D map.output.key.value.fields.spec=6,5,1-3:0- \ ('0-: ' is default in code) docs/streaming.html TT_Childo.a.h.mapred.lib.FieldSelectionMapReduce.configure:265
CONF-map.sort.class The default sort class for sorting keys. org.apache.hadoop.util.QuickSort mapred-default.xml TT_Childdynamic
CONF-mapred.acls.enabled Specifies whether ACLs should be checked for authorization of users for doing various queue and job level operations. ACLs are disabled by default. If enabled, access control checks are made by JobTracker and TaskTracker when requests are made by users for queue operations like submit job to a queue and kill a job in the queue and job operations like viewing the job-details (See mapreduce.job.acl-view-job) or for modifying the job (See mapreduce.job.acl-modify-job) using Map/Reduce APIs, RPCs or via the console and web user interfaces. false ('0 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.ACLsManager.<init>:55
JobTrackero.a.h.mapred.ACLsManager.<init>:55
JobTrackero.a.h.mapred.JobACLsManager.areACLsEnabled:37
JobTrackero.a.h.mapred.JobTracker.areACLsEnabled:3869
JobTrackero.a.h.mapred.QueueManager.<init>:107
CONF-mapred.binary.partitioner.left.offset ('0 ' is default in code) TT_Childo.a.h.mapreduce.lib.partition.BinaryPartitioner.setConf:116
CONF-mapred.binary.partitioner.right.offset ('-1 ' is default in code) TT_Childo.a.h.mapreduce.lib.partition.BinaryPartitioner.setConf:117
CONF-mapred.cache.archives Set internally by JobTracker o.a.h.filecache.DistributedCache.addCacheArchive:406 TT_Childo.a.h.filecache.DistributedCache.getCacheArchives:255
JobTrackero.a.h.filecache.DistributedCache.addCacheArchive:405
JobTrackero.a.h.filecache.DistributedCache.getCacheArchives:255
JobTrackero.a.h.filecache.TrackerDistributedCacheManager.validate:945
CONF-mapred.cache.archives.timestamps Set internally by JobTracker o.a.h.filecache.DistributedCache.setArchiveTimestamps:340 TaskTrackerdynamic
CONF-mapred.cache.files Set internally by JobTracker o.a.h.filecache.DistributedCache.addCacheFile:418 TT_Childo.a.h.filecache.DistributedCache.getCacheFiles:266
JobTrackero.a.h.filecache.DistributedCache.addCacheFile:417
JobTrackero.a.h.filecache.DistributedCache.getCacheFiles:266
JobTrackero.a.h.filecache.TrackerDistributedCacheManager.validate:947
CONF-mapred.cache.files.timestamps Set internally by JobTracker o.a.h.filecache.DistributedCache.setFileTimestamps:351 TaskTrackerdynamic
CONF-mapred.cache.localArchives TT_Childo.a.h.filecache.DistributedCache.getLocalCacheArchives:278
CONF-mapred.cache.localFiles TT_Childo.a.h.filecache.DistributedCache.getLocalCacheFiles:291
CONF-mapred.child.env User added environment variables for the task tracker child processes. Example : 1) A=foo This will set the env variable A to foo 2) B=$B:c This is inherit tasktracker's B env variable. mapred-default.xml TaskTrackero.a.h.mapred.TaskRunner.getChildEnv:163
CONF-mapred.child.java.opts Java opts for the task tracker child processes. The following symbol, if present, will be interpolated: @taskid@ is replaced by current TaskID. Any other occurrences of '@' will go unchanged. For example, to enable verbose gc logging to a file named for the taskid in /tmp and to set the heap maximum to be a gigabyte, pass a 'value' of: -Xmx1024m -verbose:gc -Xloggc:/tmp/@taskid@.gc The configuration variable mapred.child.ulimit can be used to control the maximum virtual memory of the child processes. -Xmx200m ('-Xmx200m ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.TaskRunner.getChildJavaOpts:136
CONF-mapred.child.tmp To set the value of tmp directory for map and reduce tasks. If the value is an absolute path, it is directly assigned. Otherwise, it is prepended with task's working directory. The java tasks are executed with option -Djava.io.tmpdir='the absolute path of the tmp dir'. Pipes and streaming are set with environment variable, TMPDIR='the absolute path of the tmp dir' ./tmp ('./tmp ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.TaskRunner.createChildTmpDir:498
TT_Childo.a.h.mapred.TaskRunner.createChildTmpDir:498
CONF-mapred.child.ulimit The maximum virtual memory, in KB, of a process launched by the Map-Reduce framework. This can be used to control both the Mapper/Reducer tasks and applications using Hadoop Pipes, Hadoop Streaming etc. By default it is left unspecified to let cluster admins control it via limits.conf and other such relevant mechanisms. Note: mapred.child.ulimit must be greater than or equal to the -Xmx passed to JavaVM, else the VM might not start. ('-1 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.TaskRunner.getChildUlimit:150
CONF-mapred.cluster.average.blacklist.threshold ('0.5 ' is default in code) JobTrackero.a.h.mapred.JobTracker.<init>:2107
CONF-mapred.cluster.map.memory.mb The size, in terms of virtual memory, of a single map slot in the Map-Reduce framework, used by the scheduler. A job can ask for multiple slots for a single map task via mapred.job.map.memory.mb, upto the limit specified by mapred.cluster.max.map.memory.mb, if the scheduler supports the feature. The value of -1 indicates that this feature is turned off. -1 ('-1 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.TaskTracker.initializeMemoryManagement:3906
JobTrackero.a.h.mapred.JobTracker.initializeTaskMemoryRelatedConfig:4859
CONF-mapred.cluster.max.map.memory.mb The maximum size, in terms of virtual memory, of a single map task launched by the Map-Reduce framework, used by the scheduler. A job can ask for multiple slots for a single map task via mapred.job.map.memory.mb, upto the limit specified by mapred.cluster.max.map.memory.mb, if the scheduler supports the feature. The value of -1 indicates that this feature is turned off. -1 ('-1 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobTracker.initializeTaskMemoryRelatedConfig:4888
CONF-mapred.cluster.max.reduce.memory.mb The maximum size, in terms of virtual memory, of a single reduce task launched by the Map-Reduce framework, used by the scheduler. A job can ask for multiple slots for a single reduce task via mapred.job.reduce.memory.mb, upto the limit specified by mapred.cluster.max.reduce.memory.mb, if the scheduler supports the feature. The value of -1 indicates that this feature is turned off. -1 ('-1 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobTracker.initializeTaskMemoryRelatedConfig:4893
CONF-mapred.cluster.reduce.memory.mb The size, in terms of virtual memory, of a single reduce slot in the Map-Reduce framework, used by the scheduler. A job can ask for multiple slots for a single reduce task via mapred.job.reduce.memory.mb, upto the limit specified by mapred.cluster.max.reduce.memory.mb, if the scheduler supports the feature. The value of -1 indicates that this feature is turned off. -1 ('-1 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.TaskTracker.initializeMemoryManagement:3910
JobTrackero.a.h.mapred.JobTracker.initializeTaskMemoryRelatedConfig:4863
CONF-mapred.combiner.class Set internally by JobTracker o.a.h.mapred.JobConf.setCombinerClass:1076 JobTrackero.a.h.mapred.JobConf.getCombinerClass:1049
CONF-mapred.compress.map.output Should the outputs of the maps be compressed before being sent across the network. Uses SequenceFile compression. false ('0 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobConf.getCompressMapOutput:674
CONF-mapred.create.symlink the configuration property <span class="codefrag">mapred.create.symlink</span> docs/mapred_tutorial.html TT_Childo.a.h.filecache.DistributedCache.getSymlink:543
JobTrackero.a.h.filecache.DistributedCache.getSymlink:543
CONF-mapred.data.field.separator -D mapred.data.field.separator=. \ ('' is default in code) docs/streaming.html TT_Childo.a.h.mapred.lib.FieldSelectionMapReduce.configure:264
CONF-mapred.debug.out.lines ('-1 ' is default in code) TaskTrackero.a.h.mapred.TaskTracker$TaskInProgress.taskFinished:2777
CONF-mapred.fairscheduler.allocation.file find it by setting the <em>mapred.fairscheduler.allocation.file</em> docs/fair_scheduler.html JobTrackero.a.h.mapred.PoolManager.initialize:120
CONF-mapred.fairscheduler.assignmultiple ('1 ' is default in code) JobTrackero.a.h.mapred.FairScheduler.start:185
CONF-mapred.fairscheduler.assignmultiple.maps ('-1 ' is default in code) JobTrackero.a.h.mapred.FairScheduler.start:187
CONF-mapred.fairscheduler.assignmultiple.reduces ('-1 ' is default in code) JobTrackero.a.h.mapred.FairScheduler.start:189
CONF-mapred.fairscheduler.dump.interval mapred.fairscheduler.dump.interval ('10000 ' is default in code) docs/fair_scheduler.html JobTrackero.a.h.mapred.FairScheduler.start:181
CONF-mapred.fairscheduler.eventlog.enabled mapred.fairscheduler.eventlog.enabled ('0 ' is default in code) docs/fair_scheduler.html JobTrackero.a.h.mapred.FairScheduler.start:141
CONF-mapred.fairscheduler.eventlog.location JobTrackero.a.h.mapred.FairSchedulerEventLog.init:76
CONF-mapred.fairscheduler.loadmanager mapred.fairscheduler.loadmanager docs/fair_scheduler.html JobTrackero.a.h.mapred.FairScheduler.start:161
CONF-mapred.fairscheduler.locality.delay ('-1 ' is default in code) JobTrackero.a.h.mapred.FairScheduler.start:197
CONF-mapred.fairscheduler.pool mapred.fairscheduler.pool docs/fair_scheduler.html JobTrackero.a.h.mapred.PoolManager.getPoolName:450
CONF-mapred.fairscheduler.poolnameproperty If this is specified then mapred.fairscheduler.poolnameproperty is ignored. ('user.name ' is default in code) docs/fair_scheduler.html JobTrackero.a.h.mapred.PoolManager.initialize:118
CONF-mapred.fairscheduler.preemption mapred.fairscheduler.preemption ('0 ' is default in code) docs/fair_scheduler.html JobTrackero.a.h.mapred.FairScheduler.start:193
CONF-mapred.fairscheduler.preemption.interval mapred.fairscheduler.preemption.interval ('15000 ' is default in code) docs/fair_scheduler.html JobTrackero.a.h.mapred.FairScheduler.start:183
CONF-mapred.fairscheduler.preemption.only.log mapred.fairscheduler.preemption.only.log ('0 ' is default in code) docs/fair_scheduler.html JobTrackero.a.h.mapred.FairScheduler.start:195
CONF-mapred.fairscheduler.sizebasedweight mapred.fairscheduler.sizebasedweight ('0 ' is default in code) docs/fair_scheduler.html JobTrackero.a.h.mapred.FairScheduler.start:191
CONF-mapred.fairscheduler.taskselector mapred.fairscheduler.taskselector docs/fair_scheduler.html JobTrackero.a.h.mapred.FairScheduler.start:167
CONF-mapred.fairscheduler.update.interval mapred.fairscheduler.update.interval ('2500 ' is default in code) docs/fair_scheduler.html JobTrackero.a.h.mapred.FairScheduler.start:179
CONF-mapred.fairscheduler.weightadjuster mapred.fairscheduler.weightadjuster docs/fair_scheduler.html JobTrackero.a.h.mapred.FairScheduler.start:172
CONF-mapred.healthChecker.interval Frequency of the node health script to be run, in milliseconds 60000 ('600000 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.NodeHealthCheckerService.initialize:215
CONF-mapred.healthChecker.script.args List of arguments which are to be passed to node health script when it is being launched comma seperated. mapred-default.xml TaskTrackero.a.h.mapred.NodeHealthCheckerService.initialize:219
CONF-mapred.healthChecker.script.path Absolute path to the script which is periodicallyrun by the node health monitoring service to determine if the node is healthy or not. If the value of this key is empty or the file does not exist in the location configured here, the node health monitoring service is not started. mapred-default.xml TaskTrackero.a.h.mapred.NodeHealthCheckerService.shouldRun:326
TaskTrackero.a.h.mapred.NodeHealthCheckerService.initialize:214
CONF-mapred.healthChecker.script.timeout Time after node health script should be killed if unresponsive and considered that the script has failed. 600000 ('1200000 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.NodeHealthCheckerService.initialize:217
CONF-mapred.heartbeats.in.second Expert: Approximate number of heart-beats that could arrive at JobTracker in a second. Assuming each RPC can be processed in 10msec, the default value is made 100 RPCs in a second. 100 ('100 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobTracker.<init>:2088
CONF-mapred.hosts Names a file that contains the list of nodes that may connect to the jobtracker. If the value is empty, all hosts are permitted. (' ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobTracker.refreshHosts:4680
JobTrackero.a.h.mapred.JobTracker.<init>:2118
CONF-mapred.hosts.exclude Names a file that contains the list of hosts that should be excluded by the jobtracker. If the value is empty, no hosts are excluded. (' ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobTracker.refreshHosts:4680
JobTrackero.a.h.mapred.JobTracker.<init>:2118
CONF-mapred.inmem.merge.threshold The threshold, in terms of the number of files for the in-memory merge process. When we accumulate threshold number of files we initiate the in-memory merge and spill to disk. A value of 0 or less than 0 indicates we want to DON'T have any threshold and instead depend only on the ramfs's memory consumption to trigger the merge. 1000 mapred-default.xml TT_Childdynamic
CONF-mapred.input.dir Set internally by JobTracker o.a.h.mapreduce.lib.input.FileInputFormat.setInputPaths:355 (' ' is default in code) JobTrackero.a.h.mapreduce.lib.input.FileInputFormat.getInputPaths:420
CONF-mapred.input.dir.formats JobTrackero.a.h.mapreduce.lib.input.MultipleInputs.getInputFormatMap:95
CONF-mapred.input.dir.mappers JobTrackero.a.h.mapreduce.lib.input.MultipleInputs.getMapperTypeMap:127
JobTrackero.a.h.mapreduce.lib.input.MultipleInputs.getMapperTypeMap:122
CONF-mapred.input.format.class Set internally by JobTracker o.a.h.mapred.JobConf.setInputFormat:609 TT_Childo.a.h.mapred.JobConf.getInputFormat:596
JobTrackero.a.h.mapred.JobConf.getInputFormat:596
CONF-mapred.input.pathFilter.class JobTrackero.a.h.mapreduce.lib.input.FileInputFormat.getInputPathFilter:170
CONF-mapred.jar <td colspan="1" rowspan="1">mapred.jar</td><td colspan="1" rowspan="1">String</td> /Users/asrabkin/Documents/cloudera/hadoop-0.20.2-cdh3u0/docs/streaming.html:For example, mapred.job.id becomes mapred_job_id and mapred.jar becomes mapred_jar. In your code, use the parameter names with the underscores. docs/mapred_tutorial.html TaskTrackero.a.h.mapred.JobConf.getJar:419
JobTrackero.a.h.mapred.JobConf.getJar:419
TT_Childo.a.h.mapred.JobConf.getJar:419
CONF-mapred.jdbc.driver.class TT_Childo.a.h.mapreduce.lib.db.DBConfiguration.getConnection:143
JobTrackero.a.h.mapreduce.lib.db.DBConfiguration.getConnection:143
CONF-mapred.jdbc.input.bounding.query JobTrackero.a.h.mapreduce.lib.db.DBConfiguration.getInputBoundingQuery:222
CONF-mapred.jdbc.input.conditions TT_Childo.a.h.mapreduce.lib.db.DBConfiguration.getInputConditions:177
JobTrackero.a.h.mapreduce.lib.db.DBConfiguration.getInputConditions:177
CONF-mapred.jdbc.input.count.query JobTrackero.a.h.mapreduce.lib.db.DBConfiguration.getInputCountQuery:206
CONF-mapred.jdbc.input.field.names TT_Childo.a.h.mapreduce.lib.db.DBConfiguration.getInputFieldNames:169
JobTrackero.a.h.mapreduce.lib.db.DBConfiguration.getInputFieldNames:169
CONF-mapred.jdbc.input.orderby JobTrackero.a.h.mapreduce.lib.db.DBConfiguration.getInputOrderBy:186
CONF-mapred.jdbc.input.table.name TT_Childo.a.h.mapreduce.lib.db.DBConfiguration.getInputTableName:161
JobTrackero.a.h.mapreduce.lib.db.DBConfiguration.getInputTableName:161
CONF-mapred.jdbc.password TT_Childo.a.h.mapreduce.lib.db.DBConfiguration.getConnection:149
JobTrackero.a.h.mapreduce.lib.db.DBConfiguration.getConnection:149
CONF-mapred.jdbc.url TT_Childo.a.h.mapreduce.lib.db.DBConfiguration.getConnection:149
JobTrackero.a.h.mapreduce.lib.db.DBConfiguration.getConnection:146
JobTrackero.a.h.mapreduce.lib.db.DBConfiguration.getConnection:149
TT_Childo.a.h.mapreduce.lib.db.DBConfiguration.getConnection:146
CONF-mapred.jdbc.username TT_Childo.a.h.mapreduce.lib.db.DBConfiguration.getConnection:149
JobTrackero.a.h.mapreduce.lib.db.DBConfiguration.getConnection:145
JobTrackero.a.h.mapreduce.lib.db.DBConfiguration.getConnection:149
TT_Childo.a.h.mapreduce.lib.db.DBConfiguration.getConnection:145
CONF-mapred.job.classpath.archives TaskTrackerdynamic
CONF-mapred.job.classpath.files Set internally by JobTracker o.a.h.filecache.DistributedCache.addFileToClassPath:447 JobTrackero.a.h.filecache.DistributedCache.addFileToClassPath:446
CONF-mapred.job.local.dir TaskTrackerdynamic
CONF-mapred.job.map.memory.mb The size, in terms of virtual memory, of a single map task for the job. A job can ask for multiple slots for a single map task, rounded up to the next multiple of mapred.cluster.map.memory.mb and upto the limit specified by mapred.cluster.max.map.memory.mb, if the scheduler supports the feature. The value of -1 indicates that this feature is turned off iff mapred.cluster.map.memory.mb is also turned off (-1). -1 ('-1 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.JobConf.getMemoryForMapTask:1702
JobTrackero.a.h.mapred.JobConf.getMemoryForMapTask:1702
CONF-mapred.job.name -D mapred.job.name="Experiment" \ (' ' is default in code) docs/streaming.html TT_Childo.a.h.mapred.JobConf.getJobName:1288
JobTrackero.a.h.mapred.JobConf.getJobName:1288
CONF-mapred.job.priority Set internally by JobTracker o.a.h.mapred.JobConf.setJobPriority:1418 JobTrackero.a.h.mapred.JobConf.getJobPriority:1427
CONF-mapred.job.queue.name Queue to which a job is submitted. This must match one of the queues defined in mapred.queue.names for the system. Also, the ACL setup for the queue must allow the current user to submit a job to the queue. Before specifying a queue, ensure that the system is configured with the queue, and access is allowed for submitting jobs to the queue. default ('default ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobConf.getQueueName:1761
CONF-mapred.job.reduce.input.buffer.percent The percentage of memory- relative to the maximum heap size- to retain map outputs during the reduce. When the shuffle is concluded, any remaining map outputs in memory must consume less than this threshold before the reduce can begin. 0.0 mapred-default.xml TT_Childdynamic
CONF-mapred.job.reduce.memory.mb The size, in terms of virtual memory, of a single reduce task for the job. A job can ask for multiple slots for a single map task, rounded up to the next multiple of mapred.cluster.reduce.memory.mb and upto the limit specified by mapred.cluster.max.reduce.memory.mb, if the scheduler supports the feature. The value of -1 indicates that this feature is turned off iff mapred.cluster.reduce.memory.mb is also turned off (-1). -1 ('-1 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.JobConf.getMemoryForReduceTask:1729
JobTrackero.a.h.mapred.JobConf.getMemoryForReduceTask:1729
CONF-mapred.job.reduce.total.mem.bytes TT_Childdynamic
CONF-mapred.job.reuse.jvm.num.tasks How many tasks to run per jvm. If set to -1, there is no limit. 1 ('1 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.JobConf.getNumTasksToExecutePerJvm:586
JobTrackero.a.h.mapred.JobConf.getNumTasksToExecutePerJvm:586
TT_Childo.a.h.mapred.JobConf.getNumTasksToExecutePerJvm:586
CONF-mapred.job.shuffle.input.buffer.percent The percentage of memory to be allocated from the maximum heap size to storing map outputs during the shuffle. 0.70 mapred-default.xml TT_Childdynamic
CONF-mapred.job.shuffle.merge.percent The usage threshold at which an in-memory merge will be initiated, expressed as a percentage of the total memory allocated to storing in-memory map outputs, as defined by mapred.job.shuffle.input.buffer.percent. 0.66 mapred-default.xml TT_Childdynamic
CONF-mapred.job.tracker The host and port that the MapReduce job tracker runs at. If "local", then jobs are run in-process as a single map and reduce task. local ('localhost:8012 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.JobTracker.getAddress:2425
JobCliento.a.h.mapred.JobClient.init:478
JobCliento.a.h.mapred.JobTracker.getAddress:2425
JobTrackero.a.h.mapred.JobClient.init:478
JobTrackero.a.h.mapred.JobTracker.getAddress:2425
CONF-mapred.job.tracker.handler.count The number of server threads for the JobTracker. This should be roughly 4% of the number of tasktracker nodes. 10 ('10 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobTracker.<init>:2135
CONF-mapred.job.tracker.history.completed.location The completed job history files are stored at this single well known location. If nothing is specified, the files are stored at ${hadoop.job.history.location}/done. mapred-default.xml JobTrackerdynamic
CONF-mapred.job.tracker.http.address The job tracker http server address and port the server will listen on. If the port is 0 then the server will start on a free port. 0.0.0.0:50030 mapred-default.xml JobTrackero.a.h.net.NetUtils.getServerAddress:185
JobTrackero.a.h.mapred.JobTracker.<init>:2155
CONF-mapred.job.tracker.info.bindAddress mapred.job.tracker.info.bindAddress docs/changes.html JobTrackero.a.h.net.NetUtils.getServerAddress:183
JobTrackero.a.h.mapred.JobTracker.<init>:2155
CONF-mapred.job.tracker.info.port mapred.job.tracker.info.port docs/changes.html JobTrackero.a.h.net.NetUtils.getServerAddress:184
JobTrackero.a.h.mapred.JobTracker.<init>:2155
CONF-mapred.job.tracker.jobhistory.lru.cache.size The number of job history files loaded in memory. The jobs are loaded when they are first accessed. The cache is cleared based on LRU. 5 ('5 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JSPUtil.getJobInfo:485
CONF-mapred.job.tracker.persist.jobstatus.active Indicates if persistency of job status information is active or not. false ('0 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.CompletedJobStatusStore.<init>:66
CONF-mapred.job.tracker.persist.jobstatus.dir The directory where the job status information is persisted in a file system to be available after it drops of the memory queue and between jobtracker restarts. /jobtracker/jobsInfo ('/jobtracker/jobsInfo ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.CompletedJobStatusStore.<init>:73
CONF-mapred.job.tracker.persist.jobstatus.hours The number of hours job status information is persisted in DFS. The job status information will be available after it drops of the memory queue and between jobtracker restarts. With a zero value the job status information is not persisted at all in DFS. 0 ('0 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.CompletedJobStatusStore.<init>:70
CONF-mapred.job.tracker.retiredjobs.cache.size The number of retired job status to keep in the cache. 1000 ('1000 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobTracker.<init>:2082
CONF-mapred.jobinit.threads number of threads are configurable via mapred.jobinit.threads.<br />(Matei Zaharia and Jothi Padmanabhan via ddas)</li> ('4 ' is default in code) docs/changes.html JobTrackero.a.h.mapred.EagerTaskInitializationListener.<init>:91
CONF-mapred.jobtracker.completeuserjobs.maximum The maximum number of complete jobs per user to keep around before delegating them to the job history. 100 ('100 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobTracker.<init>:2084
CONF-mapred.jobtracker.instrumentation Expert: The instrumentation class to associate with each JobTracker. org.apache.hadoop.mapred.JobTrackerMetricsInst mapred-default.xml JobTrackero.a.h.mapred.JobTracker.getInstrumentationClass:2411
CONF-mapred.jobtracker.job.history.block.size The block size of the job history file. Since the job recovery uses job history, its important to dump job history to disk as soon as possible. Note that this is an expert level parameter. The default value is set to 3 MB. 3145728 mapred-default.xml JobTrackerdynamic
CONF-mapred.jobtracker.maxtasks.per.job The maximum number of tasks for a single job. A value of -1 indicates that there is no maximum. -1 ('-1 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobTracker.getMaxTasksPerJob:4846
CONF-mapred.jobtracker.plugins Comma-separated list of jobtracker plug-ins to be activated. mapred-default.xml JobTrackero.a.h.util.PluginDispatcher.createFromConfiguration:59
JobTrackero.a.h.mapred.JobTracker.<init>:2329
CONF-mapred.jobtracker.restart.recover "true" to enable (job) recovery upon restart, "false" to start afresh false ('0 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobTracker.<init>:2247
CONF-mapred.jobtracker.retirejob.check ('60000 ' is default in code) JobTrackero.a.h.mapred.JobTracker.<init>:2081
CONF-mapred.jobtracker.retirejob.interval ('86400000 ' is default in code) JobTrackero.a.h.mapred.JobTracker.<init>:2080
CONF-mapred.jobtracker.taskScheduler The class responsible for scheduling the tasks. org.apache.hadoop.mapred.JobQueueTaskScheduler mapred-default.xml JobTrackero.a.h.mapred.JobTracker.<init>:2130
CONF-mapred.jobtracker.taskScheduler.maxRunningTasksPerJob The maximum number of running tasks for a job before it gets preempted. No limits if undefined. ('9223372036854775807 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.LimitTasksPerJobTaskScheduler.setConf:63
CONF-mapred.jobtracker.taskalloc.capacitypad ('0.01 ' is default in code) JobTrackero.a.h.mapred.JobQueueTaskScheduler.setConf:74
CONF-mapred.line.input.format.linespermap Number of lines per split in NLineInputFormat. 1 ('1 ' is default in code) mapred-default.xml TT_Childo.a.h.mapred.lib.NLineInputFormat.configure:120
CONF-mapred.linerecordreader.maxlength TT_Childdynamic
CONF-mapred.local.dir The local directory where MapReduce stores intermediate data files. May be a comma-separated list of directories on different devices in order to spread disk i/o. Directories that do not exist are ignored. ${hadoop.tmp.dir}/mapred/local mapred-default.xml TaskTrackero.a.h.mapred.JobConf.getLocalDirs:449
JobTrackero.a.h.mapred.JobConf.getLocalDirs:449
TT_Childo.a.h.mapred.TaskRunner.setupChildMapredLocalDirs:628
TaskTrackero.a.h.mapred.DefaultTaskController.launchTask:91
CONF-mapred.local.dir.minspacekill If the space in mapred.local.dir drops under this, do not ask more tasks until all the current ones have finished and cleaned up. Also, to save the rest of the tasks we have running, kill one of them, to clean up some space. Start with the reduce tasks, then go with the ones that have finished the least. Value in bytes. 0 ('0 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.TaskTracker.initialize:749
CONF-mapred.local.dir.minspacestart If the space in mapred.local.dir drops under this, do not ask for more tasks. Value in bytes. 0 ('0 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.TaskTracker.initialize:748
CONF-mapred.map.child.env TaskTrackero.a.h.mapred.MapTaskRunner.getChildEnv:64
CONF-mapred.map.child.java.opts <td colspan="1" rowspan="1">mapred.map.child.java.opts</td> /Users/asrabkin/Documents/cloudera/hadoop-0.20.2-cdh3u0/docs/mapred_tutorial.html:   <span class="codefrag"><name>mapred.map.child.java.opts</name></span> docs/cluster_setup.html TaskTrackero.a.h.mapred.MapTaskRunner.getChildJavaOpts:51
CONF-mapred.map.child.ulimit TaskTrackero.a.h.mapred.MapTaskRunner.getChildUlimit:58
CONF-mapred.map.max.attempts Expert: The maximum number of attempts per map task. In other words, framework will try to execute a map task these many number of times before giving up on it. 4 ('4 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobConf.getMaxMapAttempts:1248
CONF-mapred.map.multithreadedrunner.threads ('10 ' is default in code) TT_Childo.a.h.mapred.lib.MultithreadedMapRunner.configure:66
CONF-mapred.map.output.compression.codec If the map outputs are compressed, how should they be compressed? org.apache.hadoop.io.compress.DefaultCodec mapred-default.xml JobTrackero.a.h.mapred.JobConf.getMapOutputCompressorClass:701
CONF-mapred.map.runner.class Set internally by JobTracker o.a.h.mapred.JobConf.setMapRunnerClass:998 JobTrackero.a.h.mapred.JobConf.getMapRunnerClass:986
CONF-mapred.map.task.debug.script properties <span class="codefrag">mapred.map.task.debug.script</span> and docs/mapred_tutorial.html TaskTrackero.a.h.mapred.JobConf.getMapDebugScript:1595
JobTrackero.a.h.mapred.JobConf.getMapDebugScript:1595
CONF-mapred.map.tasks The default number of map tasks per job. Ignored when mapred.job.tracker is "local". 2 ('1 ' is default in code) mapred-default.xml JobTrackero.a.h.mapreduce.lib.db.TextSplitter.split:89
JobTrackero.a.h.mapred.JobConf.getNumMapTasks:1154
JobTrackero.a.h.mapreduce.lib.db.BigDecimalSplitter.split:48
JobTrackero.a.h.mapreduce.lib.db.DBInputFormat.getSplits:241
JobTrackero.a.h.mapreduce.lib.db.DataDrivenDBInputFormat.getSplits:163
JobTrackero.a.h.mapreduce.lib.db.DateSplitter.split:58
JobTrackero.a.h.mapreduce.lib.db.FloatSplitter.split:64
JobTrackero.a.h.mapreduce.lib.db.IntegerSplitter.split:42
CONF-mapred.map.tasks.speculative.execution If true, then multiple instances of some map tasks may be executed in parallel. true ('1 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobConf.getMapSpeculativeExecution:1110
CONF-mapred.mapoutput.key.class Set internally by JobTracker o.a.h.mapred.JobConf.setMapOutputKeyClass:736 TT_Childo.a.h.mapred.JobConf.getMapOutputKeyClass:721
JobTrackero.a.h.mapred.JobConf.getMapOutputKeyClass:721
CONF-mapred.mapoutput.value.class Set internally by JobTracker o.a.h.mapred.JobConf.setMapOutputValueClass:763 JobTrackero.a.h.mapred.JobConf.getMapOutputValueClass:747
CONF-mapred.mapper.class Set internally by JobTracker o.a.h.mapred.JobConf.setMapperClass:977 TT_Childo.a.h.mapred.JobConf.getMapperClass:968
JobTrackero.a.h.mapred.JobConf.getMapperClass:968
CONF-mapred.mapper.new-api Set internally by JobTracker o.a.h.mapred.JobConf.setUseNewMapper:924 ('0 ' is default in code) JobTrackero.a.h.mapred.JobConf.getUseNewMapper:916
CONF-mapred.mapper.regex TT_Childo.a.h.mapred.lib.RegexMapper.configure:42
CONF-mapred.mapper.regex.group ('0 ' is default in code) TT_Childo.a.h.mapred.lib.RegexMapper.configure:43
CONF-mapred.max.map.failures.percent Set internally by JobTracker o.a.h.mapred.JobConf.setMaxMapTaskFailuresPercent:1378 ('0 ' is default in code) JobTrackero.a.h.mapred.JobConf.getMaxMapTaskFailuresPercent:1364
CONF-mapred.max.reduce.failures.percent Set internally by JobTracker o.a.h.mapred.JobConf.setMaxReduceTaskFailuresPercent:1409 ('0 ' is default in code) JobTrackero.a.h.mapred.JobConf.getMaxReduceTaskFailuresPercent:1395
CONF-mapred.max.split.size ('9223372036854775807 ' is default in code) JobTrackero.a.h.mapreduce.lib.input.FileInputFormat.getMaxSplitSize:159
CONF-mapred.max.tracker.blacklists The number of blacklists for a taskTracker by various jobs after which the task tracker could be blacklisted across all jobs. The tracker will be given a tasks later (after a day). The tracker will become a healthy tracker after a restart. 4 ('4 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobTracker.<init>:2085
CONF-mapred.max.tracker.failures The number of task-failures on a tasktracker of a given job after which new tasks of that job aren't assigned to it. 4 ('4 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobConf.getMaxTaskFailuresPerTracker:1347
CONF-mapred.merge.recordsBeforeProgress The number of records to process during merge before sending a progress notification to the TaskTracker. 10000 mapred-default.xml TT_Childdynamic
CONF-mapred.min.split.size The minimum size chunk that map input should be split into. Note that some file formats may have minimum split sizes that take priority over this setting. 0 ('1 ' is default in code) mapred-default.xml JobTrackero.a.h.mapreduce.lib.input.FileInputFormat.getMinSplitSize:140
CONF-mapred.newjobweightbooster.duration <em>mapred.newjobweightbooster.duration</em> ('300000 ' is default in code) docs/fair_scheduler.html JobTrackero.a.h.mapred.NewJobWeightBooster.setConf:42
CONF-mapred.newjobweightbooster.factor <em>mapred.newjobweightbooster.factor</em> ('3.0 ' is default in code) docs/fair_scheduler.html JobTrackero.a.h.mapred.NewJobWeightBooster.setConf:40
CONF-mapred.output.committer.class Set internally by JobTracker o.a.h.mapred.JobConf.setOutputCommitter:644 JobTrackero.a.h.mapred.JobConf.getOutputCommitter:632
CONF-mapred.output.compress Should the job outputs be compressed? false mapred-default.xml TT_Childdynamic
CONF-mapred.output.dir they will be in "mapred.output.dir/_logs/history/". User can stop /Users/asrabkin/Documents/cloudera/hadoop-0.20.2-cdh3u0/docs/mapred_tutorial.html: will be in mapred.output.dir/_logs/history. User can stop docs/cluster_setup.html JobTrackero.a.h.mapred.FileOutputFormat.getOutputPath:158
CONF-mapred.output.format.class Set internally by JobTracker o.a.h.mapred.JobConf.setOutputFormat:654 JobTrackero.a.h.mapred.JobConf.getOutputFormat:619
CONF-mapred.output.key.class Set internally by JobTracker o.a.h.mapred.JobConf.setOutputKeyClass:782 TT_Childo.a.h.mapred.JobConf.getOutputKeyClass:772
JobTrackero.a.h.mapred.JobConf.getOutputKeyClass:772
CONF-mapred.output.key.comparator.class -D mapred.output.key.comparator.class=org.apache.hadoop.mapred.lib.KeyFieldBasedComparator \ docs/streaming.html TT_Childo.a.h.mapred.JobConf.getOutputKeyComparator:791
JobTrackero.a.h.mapred.JobConf.getOutputKeyComparator:791
CONF-mapred.output.value.class Set internally by JobTracker o.a.h.mapred.JobConf.setOutputValueClass:959 JobTrackero.a.h.mapred.JobConf.getOutputValueClass:950
CONF-mapred.output.value.groupfn.class Set internally by JobTracker o.a.h.mapred.JobConf.setOutputValueGroupingComparator:906 JobTrackero.a.h.mapred.JobConf.getOutputValueGroupingComparator:870
CONF-mapred.partitioner.class Set internally by JobTracker o.a.h.mapred.JobConf.setPartitionerClass:1019 JobTrackero.a.h.mapred.JobConf.getPartitionerClass:1008
CONF-mapred.queue..*.state <td><a name="mapred.queue.default.state">mapred.queue.default.state</a></td><td>RUNNING</td><td> ('* ' is default in code) docs/mapred-default.html JobTrackero.a.h.mapred.QueueManager.getQueueAcls:299
JobTrackero.a.h.mapred.QueueManager.checkDeprecation:277
CONF-mapred.queue.default.acl-administer-jobs TaskTrackerdynamic
JobTrackerdynamic
CONF-mapred.queue.default.acl-submit-job JobTrackerdynamic
CONF-mapred.queue.names Comma separated list of queues configured for this jobtracker. Jobs are added to queues and schedulers can configure different scheduling properties for the various queues. To configure a property for a queue, the name of the queue must match the name specified in this value. Queue properties that are common to all schedulers are configured here with the naming convention, mapred.queue.$QUEUE-NAME.$PROPERTY-NAME, for e.g. mapred.queue.default.submit-job-acl. The number of queues configured in this parameter could depend on the type of scheduler being used, as specified in mapred.jobtracker.taskScheduler. For example, the JobQueueTaskScheduler supports only a single queue, which is the default configured here. Before adding more queues, ensure that the scheduler you've configured supports multiple queues. default mapred-default.xml JobTrackero.a.h.mapred.QueueManager.parseQueues:115
JobTrackero.a.h.mapred.QueueManager.checkDeprecation:272
CONF-mapred.reduce.child.env TaskTrackero.a.h.mapred.ReduceTaskRunner.getChildEnv:68
CONF-mapred.reduce.child.java.opts <td colspan="1" rowspan="1">mapred.reduce.child.java.opts</td> /Users/asrabkin/Documents/cloudera/hadoop-0.20.2-cdh3u0/docs/mapred_tutorial.html:   <span class="codefrag"><name>mapred.reduce.child.java.opts</name></span> docs/cluster_setup.html TaskTrackero.a.h.mapred.ReduceTaskRunner.getChildJavaOpts:55
CONF-mapred.reduce.child.ulimit TaskTrackero.a.h.mapred.ReduceTaskRunner.getChildUlimit:62
CONF-mapred.reduce.copy.backoff The maximum amount of time (in seconds) a reducer spends on fetching one map output before declaring it as failed. 300 mapred-default.xml TT_Childdynamic
CONF-mapred.reduce.max.attempts Expert: The maximum number of attempts per reduce task. In other words, framework will try to execute a reduce task these many number of times before giving up on it. 4 ('4 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobConf.getMaxReduceAttempts:1269
CONF-mapred.reduce.parallel.copies The default number of parallel transfers run by reduce during the copy(shuffle) phase. 5 mapred-default.xml TT_Childdynamic
CONF-mapred.reduce.slowstart.completed.maps Fraction of the number of maps in the job which should be complete before reduces are scheduled for the job. 0.05 mapred-default.xml JobTrackero.a.h.mapred.JobInProgress.initTasks:751
CONF-mapred.reduce.task.debug.script <span class="codefrag">mapred.reduce.task.debug.script</span>, for debugging map and docs/mapred_tutorial.html TaskTrackero.a.h.mapred.JobConf.getReduceDebugScript:1632
JobTrackero.a.h.mapred.JobConf.getReduceDebugScript:1632
CONF-mapred.reduce.tasks The default number of reduce tasks per job. Typically set to 99% of the cluster's reduce capacity, so that if a node fails the reduces can still be executed in a single wave. Ignored when mapred.job.tracker is "local". 1 ('1 ' is default in code) mapred-default.xml TT_Childo.a.h.mapred.JobConf.getNumReduceTasks:1202
JobTrackero.a.h.mapred.JobConf.getNumReduceTasks:1202
CONF-mapred.reduce.tasks.speculative.execution If true, then multiple instances of some reduce tasks may be executed in parallel. true ('1 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobConf.getReduceSpeculativeExecution:1133
CONF-mapred.reducer.class Set internally by JobTracker o.a.h.mapred.JobConf.setReducerClass:1038 JobTrackero.a.h.mapred.JobConf.getReducerClass:1028
CONF-mapred.reducer.new-api Set internally by JobTracker o.a.h.mapred.JobConf.setUseNewReducer:941 ('0 ' is default in code) JobTrackero.a.h.mapred.JobConf.getUseNewReducer:933
CONF-mapred.skip.attempts.to.start.skipping The number of Task attempts AFTER which skip mode will be kicked off. When skip mode is kicked off, the tasks reports the range of records which it will process next, to the TaskTracker. So that on failures, TT knows which ones are possibly the bad records. On further executions, those are skipped. 2 ('2 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.SkipBadRecords.getAttemptsToStartSkipping:99
CONF-mapred.skip.map.auto.incr.proc.count The flag which if set to true, SkipBadRecords.COUNTER_MAP_PROCESSED_RECORDS is incremented by MapRunner after invoking the map function. This value must be set to false for applications which process the records asynchronously or buffer the input records. For example streaming. In such cases applications should increment this counter on their own. true ('1 ' is default in code) mapred-default.xml TT_Childo.a.h.mapred.SkipBadRecords.getAutoIncrMapperProcCount:134
CONF-mapred.skip.map.max.skip.records The number of acceptable skip records surrounding the bad record PER bad record in mapper. The number includes the bad record as well. To turn the feature of detection/skipping of bad records off, set the value to 0. The framework tries to narrow down the skipped range by retrying until this threshold is met OR all attempts get exhausted for this task. Set the value to Long.MAX_VALUE to indicate that framework need not try to narrow down. Whatever records(depends on application) get skipped are acceptable. 0 ('0 ' is default in code) mapred-default.xml TT_Childo.a.h.mapred.SkipBadRecords.getMapperMaxSkipRecords:247
JobTrackero.a.h.mapred.SkipBadRecords.getMapperMaxSkipRecords:247
CONF-mapred.skip.on ('0 ' is default in code) TT_Childo.a.h.mapred.pipes.PipesReducer.configure:52
CONF-mapred.skip.reduce.max.skip.groups The number of acceptable skip groups surrounding the bad group PER bad group in reducer. The number includes the bad group as well. To turn the feature of detection/skipping of bad groups off, set the value to 0. The framework tries to narrow down the skipped range by retrying until this threshold is met OR all attempts get exhausted for this task. Set the value to Long.MAX_VALUE to indicate that framework need not try to narrow down. Whatever groups(depends on application) get skipped are acceptable. 0 ('0 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.SkipBadRecords.getReducerMaxSkipGroups:286
CONF-mapred.submit.replication The replication level for submitted job files. This should be around the square root of the number of nodes. 10 ('10 ' is default in code) mapred-default.xml JobTrackero.a.h.mapreduce.split.JobSplitWriter.createFile:92
JobTrackero.a.h.mapred.JobClient.copyAndConfigureFiles:636
CONF-mapred.system.dir The directory where MapReduce stores control files. ${hadoop.tmp.dir}/mapred/system ('/tmp/hadoop/mapred/system ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.LocalJobRunner.getSystemDir:511
JobTrackero.a.h.mapred.JobTracker.getSystemDir:4411
CONF-mapred.task.cache.levels This is the max level of the task cache. For example, if the level is 2, the tasks cached are at the host level and at the rack level. 2 ('2 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobTracker.<init>:2324
CONF-mapred.task.default.maxvmem <span class="codefrag">mapred.task.default.maxvmem</span>, or /Users/asrabkin/Documents/cloudera/hadoop-0.20.2-cdh3u0/docs/cluster_setup.html:<td colspan="1" rowspan="1">mapred.task.default.maxvmem</td><td colspan="1" rowspan="1">long</td> ('-1 ' is default in code) docs/capacity_scheduler.html TaskTrackero.a.h.mapred.TaskTracker.initializeMemoryManagement:3920
TaskTrackero.a.h.mapred.TaskTracker.initializeMemoryManagement:3870
CONF-mapred.task.id <li>Fix <a href="http://issues.apache.org/jira/browse/HADOOP-144">HADOOP-144</a>. Use mapred task id for dfs client id, to /Users/asrabkin/Documents/cloudera/hadoop-0.20.2-cdh3u0/docs/mapred_tutorial.html:<td colspan="1" rowspan="1">mapred.task.id</td><td colspan="1" rowspan="1"> String</td> docs/changes.html FS_Shello.a.h.hdfs.DFSClient.<init>:203
DFSAdmino.a.h.hdfs.DFSClient.<init>:203
CONF-mapred.task.limit.maxvmem <span class="codefrag">mapred.task.limit.maxvmem</span>, disables memory-based /Users/asrabkin/Documents/cloudera/hadoop-0.20.2-cdh3u0/docs/cluster_setup.html:<td colspan="1" rowspan="1">mapred.task.limit.maxvmem</td><td colspan="1" rowspan="1">long</td> ('-1 ' is default in code) docs/capacity_scheduler.html TaskTrackero.a.h.mapred.TaskTracker.initializeMemoryManagement:3923
JobTrackero.a.h.mapred.JobTracker.initializeTaskMemoryRelatedConfig:4868
JobTrackero.a.h.mapred.JobTracker.initializeTaskMemoryRelatedConfig:4876
TaskTrackero.a.h.mapred.TaskTracker.initializeMemoryManagement:3877
CONF-mapred.task.maxvmem <td colspan="1" rowspan="1"><span class="codefrag">mapred.task.maxvmem</span></td><td colspan="1" rowspan="1">int</td> ('-1 ' is default in code) docs/mapred_tutorial.html TaskTrackero.a.h.mapred.JobConf.getDeprecatedMemoryValue:1741
DataNodeo.a.h.mapred.JobConf.checkAndWarnDeprecation:1957
FS_Shello.a.h.mapred.JobConf.checkAndWarnDeprecation:1957
JobCliento.a.h.mapred.JobConf.checkAndWarnDeprecation:1957
JobTrackero.a.h.mapred.JobConf.checkAndWarnDeprecation:1957
JobTrackero.a.h.mapred.JobConf.getDeprecatedMemoryValue:1741
JobTrackero.a.h.mapred.JobConf.getMaxVirtualMemoryForTask:1884
JobTrackero.a.h.mapred.JobConf.setMaxVirtualMemoryForTask:1923
NameNodeo.a.h.mapred.JobConf.checkAndWarnDeprecation:1957
TT_Childo.a.h.mapred.JobConf.checkAndWarnDeprecation:1957
TaskTrackero.a.h.mapred.JobConf.checkAndWarnDeprecation:1957
CONF-mapred.task.profile To set whether the system should collect profiler information for some of the tasks in this job? The information is stored in the user log directory. The value is "true" if task profiling is enabled. false ('0 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.JobConf.getProfileEnabled:1480
JobTrackero.a.h.mapred.JobConf.getProfileEnabled:1480
CONF-mapred.task.profile.maps To set the ranges of map tasks to profile. mapred.task.profile has to be set to true for the value to be accounted. 0-2 ('0-2 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.JobConf.getProfileTaskRange:1545
JobTrackero.a.h.mapred.JobConf.getProfileTaskRange:1545
CONF-mapred.task.profile.params <span class="codefrag">mapred.task.profile.params</span>. The value can be specified ('-agentlib:hprof=cpu=samples heap=sites force=n thread=y verbose=n file=%s ' is default in code) docs/mapred_tutorial.html TaskTrackero.a.h.mapred.JobConf.getProfileParams:1521
JobTrackero.a.h.mapred.JobConf.getProfileParams:1521
CONF-mapred.task.profile.reduces To set the ranges of reduce tasks to profile. mapred.task.profile has to be set to true for the value to be accounted. 0-2 ('0-2 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.JobConf.getProfileTaskRange:1545
JobTrackero.a.h.mapred.JobConf.getProfileTaskRange:1545
CONF-mapred.task.timeout The number of milliseconds before a task will be terminated if it neither reads an input, writes an output, nor updates its status string. 600000 ('600000 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.TaskTracker$TaskInProgress.setJobConf:2456
CONF-mapred.task.tracker.http.address The task tracker http server address and port. If the port is 0 then the server will start on a free port. 0.0.0.0:50060 mapred-default.xml TaskTrackero.a.h.net.NetUtils.getServerAddress:185
TaskTrackero.a.h.mapred.TaskTracker.<init>:1403
CONF-mapred.task.tracker.report.address The interface and port that task tracker server listens on. Since it is only connected to by the tasks, it uses the local interface. EXPERT ONLY. Should only be changed if your host does not have the loopback interface. 127.0.0.1:0 mapred-default.xml TaskTrackero.a.h.net.NetUtils.getServerAddress:185
TaskTrackero.a.h.mapred.TaskTracker.initialize:766
CONF-mapred.task.tracker.report.bindAddress mapred.task.tracker.report.bindAddress docs/changes.html TaskTrackero.a.h.net.NetUtils.getServerAddress:183
TaskTrackero.a.h.mapred.TaskTracker.initialize:766
CONF-mapred.task.tracker.report.port TaskTrackero.a.h.net.NetUtils.getServerAddress:184
TaskTrackero.a.h.mapred.TaskTracker.initialize:766
CONF-mapred.task.tracker.task-controller TaskController which is used to launch and manage task execution org.apache.hadoop.mapred.DefaultTaskController mapred-default.xml TaskTrackero.a.h.mapred.TaskTracker.<init>:1420
CONF-mapred.tasktracker.dns.interface The name of the Network Interface from which a task tracker should report its IP address. default ('default ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.TaskTracker.initialize:726
CONF-mapred.tasktracker.dns.nameserver The host name or IP address of the name server (DNS) which a TaskTracker should use to determine the host name used by the JobTracker for communication and display purposes. default ('default ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.TaskTracker.initialize:726
CONF-mapred.tasktracker.events.batchsize ('500 ' is default in code) TaskTrackero.a.h.mapred.TaskTracker.initialize:751
CONF-mapred.tasktracker.expiry.interval Expert: The time-interval, in miliseconds, after which a tasktracker is declared 'lost' if it doesn't send heartbeats. 600000 ('600000 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobTracker.<init>:2078
CONF-mapred.tasktracker.file.cache.size ('2000 ' is default in code) TaskTrackero.a.h.mapred.TaskTracker.<init>:1396
CONF-mapred.tasktracker.indexcache.mb The maximum memory that a task tracker allows for the index cache that is used when serving map outputs to reducers. 10 ('10 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.IndexCache.<init>:44
CONF-mapred.tasktracker.instrumentation Expert: The instrumentation class to associate with each TaskTracker. org.apache.hadoop.mapred.TaskTrackerMetricsInst mapred-default.xml TaskTrackero.a.h.mapred.TaskTracker.getInstrumentationClass:868
CONF-mapred.tasktracker.map.tasks.maximum The maximum number of map tasks that will be run simultaneously by a task tracker. 2 ('2 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.TaskTracker.<init>:1397
CONF-mapred.tasktracker.memory_calculator_plugin Name of the class whose instance will be used to query memory information on the tasktracker. The class must be an instance of org.apache.hadoop.util.MemoryCalculatorPlugin. If the value is null, the tasktracker attempts to use a class appropriate to the platform. Currently, the only platform supported is Linux. mapred-default.xml TaskTrackero.a.h.mapred.TaskTracker.initializeMemoryManagement:3883
CONF-mapred.tasktracker.pmem.reserved <td colspan="1" rowspan="1">mapred.tasktracker.pmem.reserved</td><td colspan="1" rowspan="1">int</td> docs/cluster_setup.html TaskTrackero.a.h.mapred.TaskTracker.initializeMemoryManagement:3863
CONF-mapred.tasktracker.reduce.tasks.maximum The maximum number of reduce tasks that will be run simultaneously by a task tracker. 2 ('2 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.TaskTracker.<init>:1399
CONF-mapred.tasktracker.taskmemorymanager.monitoring-interval The interval, in milliseconds, for which the tasktracker waits between two cycles of monitoring its tasks' memory usage. Used only if tasks' memory management is enabled via mapred.tasktracker.tasks.maxmemory. 5000 ('5000 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.TaskMemoryManagerThread.<init>:58
CONF-mapred.tasktracker.tasks.sleeptime-before-sigkill The time, in milliseconds, the tasktracker waits for sending a SIGKILL to a process, after it has been sent a SIGTERM. 5000 ('250 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.JvmManager$JvmManagerForType.<init>:214
CONF-mapred.tasktracker.vmem.reserved <span class="codefrag">mapred.tasktracker.vmem.reserved</span>, /Users/asrabkin/Documents/cloudera/hadoop-0.20.2-cdh3u0/docs/cluster_setup.html:<td colspan="1" rowspan="1">mapred.tasktracker.vmem.reserved</td><td colspan="1" rowspan="1">long</td> docs/capacity_scheduler.html TaskTrackero.a.h.mapred.TaskTracker.initializeMemoryManagement:3856
CONF-mapred.text.key.comparator.options -D mapred.text.key.comparator.options=-k2,2nr \ docs/streaming.html TT_Childo.a.h.mapred.JobConf.getKeyFieldComparatorOption:834
JobTrackero.a.h.mapred.JobConf.getKeyFieldComparatorOption:834
CONF-mapred.text.key.partitioner.options -D mapred.text.key.partitioner.options=-k1,2 \ docs/streaming.html TT_Childo.a.h.mapred.JobConf.getKeyFieldPartitionerOption:859
JobTrackero.a.h.mapred.JobConf.getKeyFieldPartitionerOption:859
CONF-mapred.textoutputformat.separator TT_Childdynamic
CONF-mapred.used.genericoptionsparser Set internally by DFSAdmin o.a.h.util.GenericOptionsParser.processGeneralOptions:303 ('0 ' is default in code) JobTrackero.a.h.mapred.JobClient.copyAndConfigureFiles:648
CONF-mapred.user.jobconf.limit The maximum allowed size of the user jobconf. The default is set to 5 MB 5242880 mapred-default.xml JobTrackero.a.h.mapred.JobTracker.<init>:2074
CONF-mapred.userlog.limit.kb The maximum size of user-logs of each task in KB. 0 disables the cap. 0 ('100 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.TaskLog.getTaskLogLength:412
CONF-mapred.userlog.retain.hours The maximum time, in hours, for which the user-logs are to be retained after the job completion. 24 ('24 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.UserLogCleaner.getUserlogRetainHours:164
CONF-mapred.working.dir Set internally by JobTracker o.a.h.mapred.JobConf.getWorkingDirectory:564 JobTrackero.a.h.mapred.JobConf.getWorkingDirectory:558
CONF-mapreduce.client.tasklog.timeout ('60000 ' is default in code) JobTrackero.a.h.mapred.JobClient.init:479
JobCliento.a.h.mapred.JobClient.init:479
CONF-mapreduce.cluster.administrators mapreduce.cluster.administrators and queue administrators of the queue to /Users/asrabkin/Documents/cloudera/hadoop-0.20.2-cdh3u0/docs/mapred_tutorial.html: (<span class="codefrag">mapreduce.cluster.administrators</span>) and queue (' ' is default in code) docs/mapred-default.html TaskTrackero.a.h.mapred.ACLsManager.<init>:57
JobTrackero.a.h.mapred.ACLsManager.<init>:57
CONF-mapreduce.cluster.delegation.key.update-interval ('86400000 ' is default in code) JobTrackero.a.h.mapred.JobTracker.<init>:2058
CONF-mapreduce.cluster.delegation.token.max-lifetime ('604800000 ' is default in code) JobTrackero.a.h.mapred.JobTracker.<init>:2061
CONF-mapreduce.cluster.delegation.token.renew-interval ('86400000 ' is default in code) JobTrackero.a.h.mapred.JobTracker.<init>:2064
CONF-mapreduce.cluster.map.userlog.retain-size ('-1 ' is default in code) TaskTrackero.a.h.mapred.TaskTracker.<init>:1444
TaskTrackero.a.h.mapred.TaskLogsTruncater.<init>:66
CONF-mapreduce.cluster.reduce.userlog.retain-size ('-1 ' is default in code) TaskTrackero.a.h.mapred.TaskTracker.<init>:1446
TaskTrackero.a.h.mapred.TaskLogsTruncater.<init>:67
CONF-mapreduce.combine.class JobTrackero.a.h.mapreduce.JobContext.getCombinerClass:224
CONF-mapreduce.fileoutputcommitter.marksuccessfuljobs TT_Childdynamic
CONF-mapreduce.inputformat.class JobTrackero.a.h.mapreduce.JobContext.getInputFormatClass:200
CONF-mapreduce.job.acl-view-job Job specific access-control list for 'viewing' the job. It is only used if authorization is enabled in Map/Reduce by setting the configuration property mapred.acls.enabled to true. This specifies the list of users and/or groups who can view private details about the job. For specifying a list of users and groups the format to use is "user1,user2 group1,group". If set to '*', it allows all users/groups to modify this job. If set to ' '(i.e. space), it allows none. This configuration is used to guard some of the job-views and at present only protects APIs that can return possibly sensitive information of the job-owner like o job-level counters o task-level counters o tasks' diagnostic information o task-logs displayed on the TaskTracker web-UI and o job.xml showed by the JobTracker's web-UI Every other piece of information of jobs is still accessible by any other user, for e.g., JobStatus, JobProfile, list of jobs in the queue, etc. Irrespective of this ACL configuration, job-owner, the user who started the cluster, cluster administrators configured via mapreduce.cluster.administrators and queue administrators of the queue to which this job is submitted to configured via mapred.queue.queue-name.acl-administer-jobs in mapred-queue-acls.xml can do all the view operations on a job. By default, nobody else besides job-owner, the user who started the cluster, cluster administrators and queue administrators can perform view operations on a job. mapred-default.xml TaskTrackerdynamic
CONF-mapreduce.job.cache.archives.visibilities Set internally by JobTracker o.a.h.filecache.TrackerDistributedCacheManager.setArchiveVisibilities:888 TaskTrackerdynamic
CONF-mapreduce.job.cache.files.visibilities Set internally by JobTracker o.a.h.filecache.TrackerDistributedCacheManager.setFileVisibilities:899 TaskTrackerdynamic
CONF-mapreduce.job.complete.cancel.delegation.tokens if false - do not unregister/cancel delegation tokens from renewal, because same tokens may be used by spawned jobs true ('1 ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.JobInProgress.garbageCollect:3105
CONF-mapreduce.job.credentials.binary tasks must set the configuration "mapreduce.job.credentials.binary" to point to docs/mapred_tutorial.html JobTrackero.a.h.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal:98
JobTrackero.a.h.mapred.JobClient.readTokensFromFiles:2039
CONF-mapreduce.job.credentials.json Set internally by DFSAdmin o.a.h.util.GenericOptionsParser.processGeneralOptions:318 JobTrackero.a.h.mapred.JobClient.readTokensFromFiles:2044
CONF-mapreduce.job.dir TT_Childdynamic
CONF-mapreduce.job.hdfs-servers "mapreduce.job.hdfs-servers" for all NameNodes that tasks might docs/mapred_tutorial.html JobTrackero.a.h.mapred.JobClient.populateTokenCache:2077
CONF-mapreduce.job.jar.unpack.pattern TaskTrackerdynamic
CONF-mapreduce.job.jobTokenFile TaskTrackero.a.h.mapred.TaskRunner.getVMEnvironment:564
CONF-mapreduce.job.locality.wait.factor JobTrackerdynamic
CONF-mapreduce.job.submithost Set internally by JobTracker o.a.h.mapred.JobConf.setJobSubmitHostName:1441 JobTrackero.a.h.mapred.JobConf.getJobSubmitHostName:1450
CONF-mapreduce.job.submithostaddress Set internally by JobTracker o.a.h.mapred.JobConf.setJobSubmitHostAddress:1461 JobTrackero.a.h.mapred.JobConf.getJobSubmitHostAddress:1470
CONF-mapreduce.jobtracker.conf.version ('default ' is default in code) JobTrackero.a.h.mapred.JobTracker.getConfigVersion:5064
CONF-mapreduce.jobtracker.heartbeat.interval.min ('300 ' is default in code) JobTrackero.a.h.mapred.JobTracker.<init>:2094
CONF-mapreduce.jobtracker.heartbeats.scaling.factor ('1.0 ' is default in code) JobTrackero.a.h.mapred.JobTracker.<init>:2097
CONF-mapreduce.jobtracker.kerberos.principal (' ' is default in code) JobTrackero.a.h.security.SecurityUtil.login:230
JobTrackero.a.h.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal:87
CONF-mapreduce.jobtracker.keytab.file JobTrackero.a.h.security.SecurityUtil.login:222
CONF-mapreduce.jobtracker.split.metainfo.maxsize ('10000000 ' is default in code) JobTrackero.a.h.mapreduce.split.SplitMetaInfoReader.readSplitMetaInfo:43
CONF-mapreduce.jobtracker.staging.root.dir The root of the staging area for users' job files In practice, this should be the directory where users' home directories are located (usually /user) ${hadoop.tmp.dir}/mapred/staging ('/tmp/hadoop/mapred/staging ' is default in code) mapred-default.xml JobTrackero.a.h.mapred.LocalJobRunner.getStagingAreaDir:526
JobTrackero.a.h.mapred.JobTracker.getStagingAreaDirInternal:3825
CONF-mapreduce.map.class JobTrackero.a.h.mapreduce.JobContext.getMapperClass:212
CONF-mapreduce.output.basename TT_Childdynamic
CONF-mapreduce.outputformat.class JobTrackero.a.h.mapreduce.JobContext.getOutputFormatClass:248
CONF-mapreduce.partitioner.class JobTrackero.a.h.mapreduce.JobContext.getPartitionerClass:260
CONF-mapreduce.reduce.class JobTrackero.a.h.mapreduce.JobContext.getReducerClass:236
CONF-mapreduce.reduce.input.limit The limit on the input size of the reduce. If the estimated input size of the reduce is greater than this value, job is failed. A value of -1 means that there is no limit set. -1 mapred-default.xml JobTrackero.a.h.mapred.JobInProgress.<init>:473
CONF-mapreduce.reduce.shuffle.connect.timeout Expert: The maximum amount of time (in milli seconds) a reduce task spends in trying to connect to a tasktracker for getting map output. 180000 mapred-default.xml TT_Childdynamic
CONF-mapreduce.reduce.shuffle.notify.readerror TT_Childdynamic
CONF-mapreduce.reduce.shuffle.read.timeout Expert: The maximum amount of time (in milli seconds) a reduce task waits for map output data to be available for reading after obtaining connection. 180000 mapred-default.xml TT_Childdynamic
CONF-mapreduce.task.classpath.user.precedence Set internally by JobTracker o.a.h.mapred.JobConf.setUserClassesTakesPrecedence:1499 ('0 ' is default in code) TaskTrackero.a.h.mapred.JobConf.userClassesTakesPrecedence:1509
JobTrackero.a.h.mapred.JobConf.userClassesTakesPrecedence:1509
CONF-mapreduce.tasktracker.cache.local.numberdirectories The maximum number of subdirectories that should be created in any particular distributed cache store. After this many directories have been created, cache items will be expunged regardless of whether the total size threshold has been exceeded. 10000 ('10000 ' is default in code) mapred-default.xml TaskTrackero.a.h.filecache.TrackerDistributedCacheManager.<init>:117
CONF-mapreduce.tasktracker.kerberos.principal TaskTrackero.a.h.security.SecurityUtil.login:230
CONF-mapreduce.tasktracker.keytab.file TaskTrackero.a.h.security.SecurityUtil.login:222
CONF-mapreduce.tasktracker.outofband.heartbeat Expert: Set this to true to let the tasktracker send an out-of-band heartbeat on task-completion for better latency. false ('0 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.TaskTracker.initialize:851
CONF-mapreduce.tasktracker.task-controller.exe TaskTrackero.a.h.mapred.LinuxTaskController.setConf:80
CONF-mapreduce.tasktracker.userlogcleanup.sleeptime ('3600000 ' is default in code) TaskTrackero.a.h.mapred.UserLogCleaner.<init>:62
CONF-min.num.spills.for.combine TT_Childdynamic
CONF-num.key.fields.for.partition ('0 ' is default in code) TT_Childo.a.h.mapred.lib.KeyFieldBasedPartitioner.configure:56
TT_Childo.a.h.mapred.lib.KeyFieldBasedPartitioner.configure:53
CONF-reduce.output.key.value.fields.spec -D reduce.output.key.value.fields.spec=0-2:5- \ ('0-: ' is default in code) docs/streaming.html TT_Childo.a.h.mapred.lib.FieldSelectionMapReduce.configure:269
CONF-session.id <li><a href="http://issues.apache.org/jira/browse/HADOOP-1518">HADOOP-1518</a>. Add a session id to job metrics, for use by HOD.<br />(David Bowen via cutting)</li> (' ' is default in code) docs/changes.html TaskTrackero.a.h.mapred.JobConf.getSessionId:1316
DataNodeo.a.h.hdfs.server.datanode.metrics.DataNodeMetrics.<init>:94
JobCliento.a.h.mapred.JobConf.getSessionId:1316
JobTrackero.a.h.mapred.JobConf.getSessionId:1316
NameNodeo.a.h.hdfs.server.namenode.FSDirectory.initialize:86
NameNodeo.a.h.hdfs.server.namenode.metrics.FSNamesystemMetrics.<init>:64
NameNodeo.a.h.hdfs.server.namenode.metrics.NameNodeMetrics.<init>:89
SecondaryNNo.a.h.hdfs.server.namenode.FSDirectory.initialize:86
SecondaryNNo.a.h.hdfs.server.namenode.SecondaryNameNode.initialize:158
TT_Childo.a.h.mapred.JobConf.getSessionId:1316
CONF-slave.host.name TaskTrackero.a.h.metrics.ganglia.GangliaContext31.init:56
DFSAdmino.a.h.metrics.ganglia.GangliaContext31.init:55
DFSAdmino.a.h.metrics.ganglia.GangliaContext31.init:56
DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:317
DataNodeo.a.h.hdfs.server.datanode.DataNode.startDataNode:318
DataNodeo.a.h.metrics.ganglia.GangliaContext31.init:55
DataNodeo.a.h.metrics.ganglia.GangliaContext31.init:56
FS_Shello.a.h.metrics.ganglia.GangliaContext31.init:55
FS_Shello.a.h.metrics.ganglia.GangliaContext31.init:56
JobCliento.a.h.metrics.ganglia.GangliaContext31.init:55
JobCliento.a.h.metrics.ganglia.GangliaContext31.init:56
JobTrackero.a.h.metrics.ganglia.GangliaContext31.init:55
JobTrackero.a.h.metrics.ganglia.GangliaContext31.init:56
NameNodeo.a.h.metrics.ganglia.GangliaContext31.init:55
NameNodeo.a.h.metrics.ganglia.GangliaContext31.init:56
SecondaryNNo.a.h.metrics.ganglia.GangliaContext31.init:55
SecondaryNNo.a.h.metrics.ganglia.GangliaContext31.init:56
TT_Childo.a.h.metrics.ganglia.GangliaContext31.init:55
TT_Childo.a.h.metrics.ganglia.GangliaContext31.init:56
TaskTrackero.a.h.mapred.TaskTracker.initialize:722
TaskTrackero.a.h.mapred.TaskTracker.initialize:723
TaskTrackero.a.h.metrics.ganglia.GangliaContext31.init:55
CONF-ssl.client.keystore.keypassword (' ' is default in code) FS_Shello.a.h.hdfs.HsftpFileSystem.setupSsl:61
DFSAdmino.a.h.hdfs.HsftpFileSystem.setupSsl:61
CONF-ssl.client.keystore.location (' ' is default in code) FS_Shello.a.h.hdfs.HsftpFileSystem.setupSsl:57
DFSAdmino.a.h.hdfs.HsftpFileSystem.setupSsl:57
CONF-ssl.client.keystore.password (' ' is default in code) FS_Shello.a.h.hdfs.HsftpFileSystem.setupSsl:59
DFSAdmino.a.h.hdfs.HsftpFileSystem.setupSsl:59
CONF-ssl.client.keystore.type ('jks ' is default in code) FS_Shello.a.h.hdfs.HsftpFileSystem.setupSsl:63
DFSAdmino.a.h.hdfs.HsftpFileSystem.setupSsl:63
CONF-ssl.client.truststore.location (' ' is default in code) FS_Shello.a.h.hdfs.HsftpFileSystem.setupSsl:51
DFSAdmino.a.h.hdfs.HsftpFileSystem.setupSsl:51
CONF-ssl.client.truststore.password (' ' is default in code) FS_Shello.a.h.hdfs.HsftpFileSystem.setupSsl:53
DFSAdmino.a.h.hdfs.HsftpFileSystem.setupSsl:53
CONF-ssl.client.truststore.type ('jks ' is default in code) FS_Shello.a.h.hdfs.HsftpFileSystem.setupSsl:55
DFSAdmino.a.h.hdfs.HsftpFileSystem.setupSsl:55
CONF-ssl.server.keystore.keypassword (' ' is default in code) DataNodeo.a.h.http.HttpServer.addSslListener:532
CONF-ssl.server.keystore.location DataNodeo.a.h.http.HttpServer.addSslListener:530
CONF-ssl.server.keystore.password (' ' is default in code) DataNodeo.a.h.http.HttpServer.addSslListener:531
CONF-ssl.server.keystore.type ('jks ' is default in code) DataNodeo.a.h.http.HttpServer.addSslListener:533
CONF-ssl.server.truststore.location (' ' is default in code) DataNodeo.a.h.http.HttpServer.addSslListener:512
CONF-ssl.server.truststore.password (' ' is default in code) DataNodeo.a.h.http.HttpServer.addSslListener:514
CONF-ssl.server.truststore.type ('jks ' is default in code) DataNodeo.a.h.http.HttpServer.addSslListener:516
CONF-tasktracker.contention.tracking ('0 ' is default in code) TaskTrackero.a.h.mapred.TaskTracker.main:3519
CONF-tasktracker.http.bindAddress tasktracker.http.bindAddress docs/changes.html TaskTrackero.a.h.net.NetUtils.getServerAddress:183
TaskTrackero.a.h.mapred.TaskTracker.<init>:1403
CONF-tasktracker.http.port tasktracker.http.port docs/changes.html TaskTrackero.a.h.net.NetUtils.getServerAddress:184
TaskTrackero.a.h.mapred.TaskTracker.<init>:1403
CONF-tasktracker.http.threads The number of worker threads that for the http server. This is used for map output fetching 40 ('40 ' is default in code) mapred-default.xml TaskTrackero.a.h.mapred.TaskTracker.<init>:1414
CONF-tmparchives Set internally by DFSAdmin o.a.h.util.GenericOptionsParser.processGeneralOptions:291 JobTrackero.a.h.mapred.JobClient.copyAndConfigureFiles:657
CONF-tmpfiles Set internally by DFSAdmin o.a.h.util.GenericOptionsParser.processGeneralOptions:287 JobTrackero.a.h.mapred.JobClient.copyAndConfigureFiles:655
CONF-tmpjars Set internally by DFSAdmin o.a.h.util.GenericOptionsParser.processGeneralOptions:275 JobTrackero.a.h.util.GenericOptionsParser.getLibJars:333
DFSAdmino.a.h.util.GenericOptionsParser.getLibJars:333
FS_Shello.a.h.util.GenericOptionsParser.getLibJars:333
JobCliento.a.h.util.GenericOptionsParser.getLibJars:333
JobTrackero.a.h.mapred.JobClient.copyAndConfigureFiles:656
CONF-topology.node.switch.mapping.impl The default implementation of the DNSToSwitchMapping. It invokes a script specified in topology.script.file.name to resolve node names. If the value for topology.script.file.name is not set, the default value of DEFAULT_RACK is returned for all node names. org.apache.hadoop.net.ScriptBasedMapping core-default.xml NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.initialize:376
JobTrackero.a.h.mapred.JobTracker.<init>:2321
CONF-topology.script.file.name The script name that should be invoked to resolve DNS names to NetworkTopology names. Example: the script would take host.foo.bar as an argument, and return /rack1 as the output. core-default.xml NameNodeo.a.h.net.ScriptBasedMapping$RawScriptBasedMapping.setConf:70
JobTrackero.a.h.net.ScriptBasedMapping$RawScriptBasedMapping.setConf:70
CONF-topology.script.number.args The max number of args that the script configured with topology.script.file.name should be run with. Each arg is an IP address. 100 ('100 ' is default in code) core-default.xml NameNodeo.a.h.net.ScriptBasedMapping$RawScriptBasedMapping.setConf:71
JobTrackero.a.h.net.ScriptBasedMapping$RawScriptBasedMapping.setConf:71
CONF-total.order.partitioner.max.trie.depth ('2 ' is default in code) TT_Childo.a.h.mapred.lib.TotalOrderPartitioner.configure:84
CONF-total.order.partitioner.natural.order ('1 ' is default in code) TT_Childo.a.h.mapred.lib.TotalOrderPartitioner.configure:81
CONF-total.order.partitioner.path ('_partition.lst ' is default in code) TT_Childo.a.h.mapred.lib.TotalOrderPartitioner.getPartitionFile:115
CONF-user.name A valid user name is required. (Tsz Wo (Nicholas), SZE via rangadi) /Users/asrabkin/Documents/cloudera/hadoop-0.20.2-cdh3u0/docs/core-default.html:<td><a name="hadoop.tmp.dir">hadoop.tmp.dir</a></td><td>/tmp/hadoop-${user.name}</td><td>A base for other temporary directories.</td> /Users/asrabkin/Documents/cloudera/hadoop-0.20.2-cdh3u0/docs/fair_scheduler.html: job belongs in. String, default: <em>user.name</em> /Users/asrabkin/Documents/cloudera/hadoop-0.20.2-cdh3u0/docs/hdfs_permissions_guide.html: Each client process that accesses HDFS has a two-part identity composed of the <em>user name</em>, and <em>groups list</em>. /Users/asrabkin/Documents/cloudera/hadoop-0.20.2-cdh3u0/docs/hod_scheduler.html:<p>Under the root directory specified above in the path, HOD will create a path user_name/torque_jobid and store gzipped log files for each docs/changes.html TaskTrackero.a.h.mapred.JobConf.getUser:485
JobTrackero.a.h.mapred.JobConf.getUser:485
TT_Childo.a.h.mapred.Child.main:253
TT_Childo.a.h.mapred.Child.main:254
CONF-webinterface.private.actions If set to true, the web interfaces of JT and NN may contain actions, such as kill job, delete file, etc., that should not be exposed to public. Enable this option if the interfaces are only reachable by those who have the right authorization. false ('0 ' is default in code) core-default.xml JobTrackero.a.h.mapred.JSPUtil.privateActionsAllowed:598
PROP-Filename (' ' is default in code) FS_Shellorg.kosmix.kosmosfs.access.KfsAccess.kfs_readdirplus:184
DFSAdminorg.kosmix.kosmosfs.access.KfsAccess.kfs_readdirplus:184
PROP-Filesize ('0 ' is default in code) FS_Shellorg.kosmix.kosmosfs.access.KfsAccess.kfs_readdirplus:191
DFSAdminorg.kosmix.kosmosfs.access.KfsAccess.kfs_readdirplus:191
PROP-IsDirectory ('false ' is default in code) FS_Shellorg.kosmix.kosmosfs.access.KfsAccess.kfs_readdirplus:185
DFSAdminorg.kosmix.kosmosfs.access.KfsAccess.kfs_readdirplus:185
PROP-M-Time ('0 ' is default in code) FS_Shellorg.kosmix.kosmosfs.access.KfsAccess.kfs_readdirplus:194
DFSAdminorg.kosmix.kosmosfs.access.KfsAccess.kfs_readdirplus:194
PROP-Replicas ('1 ' is default in code) FS_Shellorg.kosmix.kosmosfs.access.KfsAccess.kfs_readdirplus:197
DFSAdminorg.kosmix.kosmosfs.access.KfsAccess.kfs_readdirplus:197
PROP-cTime NameNodeo.a.h.hdfs.server.common.Storage.getFields:734
DataNodeo.a.h.hdfs.server.common.Storage.getFields:734
PROP-distributedUpgradeState NameNodeo.a.h.hdfs.server.namenode.FSImage.getFields:557
PROP-distributedUpgradeVersion NameNodeo.a.h.hdfs.server.namenode.FSImage.getFields:558
PROP-hadoop.log.dir TaskTrackero.a.h.mapred.TaskRunner.setupLog4jProperties:478
DataNodeo.a.h.http.HttpServer.addDefaultApps:237
JobTrackero.a.h.http.HttpServer.addDefaultApps:237
JobTrackero.a.h.mapred.FairSchedulerEventLog.init:76
JobTrackero.a.h.mapred.JobHistory$JobInfo.getLocalJobFilePath:742
NameNodeo.a.h.hdfs.server.namenode.FSNamesystem.metaSave:565
TT_Childo.a.h.mapred.TaskLog.getBaseLogDir:175
TaskTrackero.a.h.http.HttpServer.addDefaultApps:237
TaskTrackero.a.h.mapred.TaskLog.getBaseLogDir:175
PROP-hadoop.policy.file ('hadoop-policy.xml ' is default in code) TaskTrackero.a.h.security.authorize.ServiceAuthorizationManager.refresh:114
DataNodeo.a.h.security.authorize.ServiceAuthorizationManager.refresh:114
JobTrackero.a.h.security.authorize.ServiceAuthorizationManager.refresh:114
NameNodeo.a.h.security.authorize.ServiceAuthorizationManager.refresh:114
PROP-java.class.path TaskTrackero.a.h.mapred.TaskRunner.appendSystemClasspaths:653
TaskTrackero.a.h.mapred.LinuxTaskController.truncateLogsAsUser:344
PROP-java.home TaskTrackero.a.h.mapred.TaskRunner.getVMArgs:376
TaskTrackero.a.h.mapred.LinuxTaskController.truncateLogsAsUser:336
PROP-java.library.path TaskTrackero.a.h.util.NativeCodeLoader.:48
DFSAdmino.a.h.util.NativeCodeLoader.:48
DFSAdminorg.kosmix.kosmosfs.access.KfsAccess.:106
DataNodeo.a.h.util.NativeCodeLoader.:48
FS_Shello.a.h.util.NativeCodeLoader.:48
FS_Shellorg.kosmix.kosmosfs.access.KfsAccess.:106
JobCliento.a.h.util.NativeCodeLoader.:48
JobTrackero.a.h.util.NativeCodeLoader.:48
NameNodeo.a.h.util.NativeCodeLoader.:48
SecondaryNNo.a.h.util.NativeCodeLoader.:48
TT_Childo.a.h.util.NativeCodeLoader.:48
TaskTrackero.a.h.mapred.LinuxTaskController.truncateLogsAsUser:339
TaskTrackero.a.h.mapred.TaskRunner.getVMArgs:423
PROP-layoutVersion NameNodeo.a.h.hdfs.server.common.Storage.getFields:731
DataNodeo.a.h.hdfs.server.common.Storage.getFields:731
PROP-line.separator TaskTrackero.a.h.util.Shell$1.run:225
DFSAdmino.a.h.util.Shell$1.run:225
DataNodeo.a.h.util.Shell$1.run:225
FS_Shello.a.h.util.Shell$1.run:225
JobCliento.a.h.util.Shell$1.run:225
JobTrackero.a.h.util.Shell$1.run:225
NameNodeo.a.h.util.Shell$1.run:225
SecondaryNNo.a.h.util.Shell$1.run:225
TT_Childo.a.h.util.Shell$1.run:225
PROP-namespaceID NameNodeo.a.h.hdfs.server.common.Storage.getFields:733
DataNodeo.a.h.hdfs.server.common.Storage.getFields:733
PROP-os.arch TaskTrackero.a.h.util.PlatformName.:30
PROP-os.name TaskTrackero.a.h.util.Shell.:137
DFSAdmino.a.h.fs.Path.:38
DFSAdmino.a.h.security.UserGroupInformation.:295
DFSAdmino.a.h.util.Shell.:137
DataNodeo.a.h.fs.FileUtil$HardLink.getOSType:583
DataNodeo.a.h.fs.Path.:38
DataNodeo.a.h.security.UserGroupInformation.:295
DataNodeo.a.h.util.Shell.:137
FS_Shello.a.h.fs.Path.:38
FS_Shello.a.h.security.UserGroupInformation.:295
FS_Shello.a.h.util.Shell.:137
JobCliento.a.h.fs.Path.:38
JobCliento.a.h.security.UserGroupInformation.:295
JobCliento.a.h.util.Shell.:137
JobTrackero.a.h.fs.Path.:38
JobTrackero.a.h.security.UserGroupInformation.:295
JobTrackero.a.h.util.Shell.:137
NameNodeo.a.h.fs.Path.:38
NameNodeo.a.h.security.UserGroupInformation.:295
NameNodeo.a.h.util.Shell.:137
SecondaryNNo.a.h.fs.Path.:38
SecondaryNNo.a.h.security.UserGroupInformation.:295
SecondaryNNo.a.h.util.Shell.:137
TT_Childo.a.h.fs.Path.:38
TT_Childo.a.h.security.UserGroupInformation.:295
TT_Childo.a.h.util.Shell.:137
TaskTrackero.a.h.fs.Path.:38
TaskTrackero.a.h.security.UserGroupInformation.:295
TaskTrackero.a.h.util.MemoryCalculatorPlugin.getMemoryCalculatorPlugin:62
TaskTrackero.a.h.util.PlatformName.:30
TaskTrackero.a.h.util.ProcfsBasedProcessTree.isAvailable:80
PROP-path.separator TaskTrackero.a.h.mapred.TaskRunner.:72
JobTrackero.a.h.filecache.DistributedCache.addFileToClassPath:447
TT_Childo.a.h.mapred.TaskRunner.:72
PROP-storageID DataNodeo.a.h.hdfs.server.datanode.DataStorage.getFields:179
PROP-storageType NameNodeo.a.h.hdfs.server.common.Storage.getFields:732
DataNodeo.a.h.hdfs.server.common.Storage.getFields:732
PROP-sun.arch.data.model TaskTrackero.a.h.util.PlatformName.:30
NameNodeo.a.h.hdfs.server.namenode.BlocksMap.computeCapacity:327
SecondaryNNo.a.h.hdfs.server.namenode.BlocksMap.computeCapacity:327
PROP-user.dir TT_Childo.a.h.fs.RawLocalFileSystem.<init>:43
DFSAdmino.a.h.fs.RawLocalFileSystem.<init>:43
FS_Shello.a.h.fs.RawLocalFileSystem.<init>:43
JobTrackero.a.h.net.ScriptBasedMapping$RawScriptBasedMapping.runResolveCommand:142
NameNodeo.a.h.net.ScriptBasedMapping$RawScriptBasedMapping.runResolveCommand:142
PROP-user.home FS_Shello.a.h.fs.RawLocalFileSystem.getHomeDirectory:325
DFSAdmino.a.h.fs.RawLocalFileSystem.getHomeDirectory:325
PROP-user.name TaskTrackero.a.h.security.SecurityUtil.login:230
DFSAdmino.a.h.fs.FileSystem.getHomeDirectory:1194
DFSAdmino.a.h.fs.kfs.KosmosFileSystem.initialize:76
DFSAdmino.a.h.fs.s3.S3FileSystem.initialize:80
DFSAdmino.a.h.fs.s3native.NativeS3FileSystem.initialize:260
DataNodeo.a.h.security.SecurityUtil.login:230
FS_Shello.a.h.fs.FileSystem.getHomeDirectory:1194
FS_Shello.a.h.fs.kfs.KosmosFileSystem.initialize:76
FS_Shello.a.h.fs.s3.S3FileSystem.initialize:80
FS_Shello.a.h.fs.s3native.NativeS3FileSystem.initialize:260
JobTrackero.a.h.mapred.FairSchedulerEventLog.init:87
JobTrackero.a.h.security.SecurityUtil.login:230
NameNodeo.a.h.security.SecurityUtil.login:230
SecondaryNNo.a.h.security.SecurityUtil.login:230
TaskTrackero.a.h.mapred.TaskTracker.initializeDirectories:689

Total of 164 undocumented options.

Total of 20 possibly unused options

Total of 37 real options missed by static analysis

These are real options that were missed by static analysis but found dynamically