> > Hadoop MCQs > Basic Hadoop MCQs

Basic Hadoop MCQ

1. To copy a file into the Hadoop file system, what command should you use?

Hadoop fs -copy

Hadoop fs -copyFromLocal

Answer

Correct Answer: Hadoop fs -copyFromLocal

Note: This Question is unanswered, help us to find answer for this one

2. What kind of storage and processing does Hadoop support?

Encrypted

Verified

Distributed

Remote

Answer

Correct Answer: Distributed

Note: This Question is unanswered, help us to find answer for this one

3. Which file system does Hadoop use for storage?

NAS

FAT

HDFS

NFS

Answer

Correct Answer: HDFS

Note: This Question is unanswered, help us to find answer for this one

4. Hadoop Common is written in which language?

C++

Haskell

Java

Answer

Correct Answer: Java

Note: This Question is unanswered, help us to find answer for this one

5. Which feature is used to roll back a corrupted HDFS instance to a previously known good point in time?

Partitioning

Snapshot

Replication

High availability

Answer

Correct Answer: Snapshot

Note: This Question is unanswered, help us to find answer for this one

6. To view the execution details of an Impala query plan, which function would you use ?

Explain

Query action

Detail

Query plan

Answer

Correct Answer: Explain

Note: This Question is unanswered, help us to find answer for this one

7. Which object can be used to distribute jars or libraries for use in MapReduce tasks?

Distributed cache

Library manager

Lookup store

Registry

Answer

Correct Answer: Distributed cache

Note: This Question is unanswered, help us to find answer for this one

8. Hadoop systems are _ RDBMS systems.

Replacements for

Not used with

Substitutes for

Additions for

Answer

Correct Answer: Additions for

Note: This Question is unanswered, help us to find answer for this one

9. Where would you configure the size of a block in a Hadoop environment?

Dfs.block.size in hdfs-site.xmls

Orc.write.variable.length.blocks in hive-default.xml

Mapreduce.job.ubertask.maxbytes in mapred-site.xml

Hdfs.block.size in hdfs-site.xml

Answer

Correct Answer: Dfs.block.size in hdfs-site.xmls

Note: This Question is unanswered, help us to find answer for this one

10. In a MapReduce job, which phase runs after the Map phase completes?

Combiner

Reducer

Map2

Shuffle and Sort

Answer

Correct Answer: Combiner

Note: This Question is unanswered, help us to find answer for this one

11. Suppose you are trying to finish a Pig script that converts text in the input string to uppercase. What code is needed on line 2 below? 1 data = LOAD '/user/hue/pig/examples/data/midsummer.txt'... 2

As (text:CHAR[]); upper_case = FOREACH data GENERATE org.apache.pig.piggybank.evaluation.string.UPPER(TEXT);

As (text:CHARARRAY); upper_case = FOREACH data GENERATE org.apache.pig.piggybank.evaluation.string.UPPER(TEXT);

As (text:CHAR[]); upper_case = FOREACH data org.apache.pig.piggybank.evaluation.string.UPPER(TEXT);

As (text:CHARARRAY); upper_case = FOREACH data org.apache.pig.piggybank.evaluation.string.UPPER(TEXT);

Answer

Correct Answer: As (text:CHARARRAY); upper_case = FOREACH data GENERATE org.apache.pig.piggybank.evaluation.string.UPPER(TEXT);

Note: This Question is unanswered, help us to find answer for this one

12. Which type of Hadoop node executes file system namespace operations like opening, closing, and renaming files and directories?

ControllerNode

DataNode

MetadataNode

NameNode

Answer

Correct Answer: NameNode

Note: This Question is unanswered, help us to find answer for this one

13. MapReduce 1.0 _ YARN

Does not include

Is the same thing as

Includes

Replaces

Answer

Correct Answer: Does not include

Note: This Question is unanswered, help us to find answer for this one

14. _ is the query language, and _ is storage for NoSQL on Hadoop

HDFS; HQL

HQL; HBase

HDFS; SQL

SQL; HBase

Answer

Correct Answer: HQL; HBase

Note: This Question is unanswered, help us to find answer for this one

15. MapReduce applications use which of these classes to report their statistics?

Mapper

Reducer

Combiner

Counter

Answer

Correct Answer: Counter

Note: This Question is unanswered, help us to find answer for this one

16. If no reduction is desired, you should set the numbers of _ tasks to zero

Combiner

Reduce

Mapper

Intermediate

Answer

Correct Answer: Reduce

Note: This Question is unanswered, help us to find answer for this one

17. What type of software is Hadoop Common?

Database

Distributed computing framework

Operating system

Productivity tool

Answer

Correct Answer: Distributed computing framework

Note: This Question is unanswered, help us to find answer for this one

18. In MapReduce, _ have _

Tasks; jobs

Jobs; activities

Jobs; tasks

Activities; tasks

Answer

Correct Answer: Jobs; tasks

Note: This Question is unanswered, help us to find answer for this one

19. Hadoop 2.x and later implement which service as the resource coordinator?

Kubernetes

JobManager

JobTracker

YARN

Answer

Correct Answer: YARN

Note: This Question is unanswered, help us to find answer for this one

20. To implement high availability, how many instances of the master node should you configure?

One

Zero

Shared

Two or more (https://data-flair.training/blogs/hadoop-high-availability-tutorial)

Answer

Correct Answer: Two or more (https://data-flair.training/blogs/hadoop-high-availability-tutorial)

Note: This Question is unanswered, help us to find answer for this one

21. Which Hive query returns the first 1,000 values?

SELECT…WHERE value = 1000

SELECT … LIMIT 1000

SELECT TOP 1000 …

SELECT MAX 1000…

Answer

Correct Answer: SELECT … LIMIT 1000

Note: This Question is unanswered, help us to find answer for this one

22. To what does the Mapper map input key/value pairs?

An average of keys for values

A sum of keys for values

A set of intermediate key/value pairs

A set of final key/value pairs

Answer

Correct Answer: A set of intermediate key/value pairs

Note: This Question is unanswered, help us to find answer for this one

23. In what format does RecordWriter write an output file?

pairs

Keys

Values

pairs

Answer

Correct Answer: pairs

Note: This Question is unanswered, help us to find answer for this one

24. In the Hadoop system, what administrative mode is used for maintenance?

Data mode

Safe mode

Single-user mode

Pseudo-distributed mode

Answer

Correct Answer: Safe mode

Note: This Question is unanswered, help us to find answer for this one

25. When implemented on a public cloud, with what does Hadoop processing interact?

Files in object storage

Graph data in graph databases

Relational data in managed RDBMS systems

JSON data in NoSQL databases

Answer

Correct Answer: Files in object storage

Note: This Question is unanswered, help us to find answer for this one

26. What is the output of the Reducer?

A relational table

An update to the input file

A single, combined list

A set of pairs

Answer

Correct Answer: A set of pairs

Note: This Question is unanswered, help us to find answer for this one

27. Which library should you use to perform ETL-type MapReduce jobs?

Hive

Pig

Impala

Mahout

Answer

Correct Answer: Pig

Note: This Question is unanswered, help us to find answer for this one

28. A distributed cache file path can originate from what location?

Hdfs or top

Http

Hdfs or http

Hdfs

Answer

Correct Answer: Hdfs or http

Note: This Question is unanswered, help us to find answer for this one

29. HDFS file are of what type?

Read-write

Read-only

Write-only

Append-only

Answer

Correct Answer: Append-only

Note: This Question is unanswered, help us to find answer for this one

30. HBase works with which type of schema enforcement?

Schema on write

No schema

External schema

Schema on read

Answer

Correct Answer: Schema on read

Note: This Question is unanswered, help us to find answer for this one

31. To connect Hadoop to AWS S3, which client should you use?

S3A

S3N

The EMR S3

Answer

Correct Answer: S3A

Note: This Question is unanswered, help us to find answer for this one

32. To create a MapReduce job, what should be coded first?

A static job() method

A Job class and instance (NOT SURE)

A job() method

A static Job class

Answer

Correct Answer: A Job class and instance (NOT SURE)

Note: This Question is unanswered, help us to find answer for this one

33. State _ between the JVMs in a MapReduce job

Can be configured to be shared

Is partially shared

Is shared

Is not shared (https://www.lynda.com/Hadoop-tutorials/Understanding-Java-virtual-machines-JVMs/191942/369545-4.html)

Answer

Correct Answer: Is not shared (https://www.lynda.com/Hadoop-tutorials/Understanding-Java-virtual-machines-JVMs/191942/369545-4.html)

Note: This Question is unanswered, help us to find answer for this one

34. If you started the NameNode, then which kind of user must you be?

Hadoop-user

Super-user

Node-user

Admin-user

Answer

Correct Answer: Super-user

Note: This Question is unanswered, help us to find answer for this one

35. Which library should be used to unit test MapReduce code?

JUnit

XUnit

MRUnit

HadoopUnit

Answer

Correct Answer: MRUnit

Note: This Question is unanswered, help us to find answer for this one

36. In what form is Reducer output presented?

Compressed (NOT SURE)

Sorted

Not sorted

Encrypted

Answer

Correct Answer: Compressed (NOT SURE)

Note: This Question is unanswered, help us to find answer for this one

37. Which command imports data to Hadoop from a MySQL database?

Spark import --connect jdbc:mysql://mysql.example.com/spark --username spark --warehouse-dir user/hue/oozie/deployments/spark

Sqoop import --connect jdbc:mysql://mysql.example.com/sqoop --username sqoop --warehouse-dir user/hue/oozie/deployments/sqoop

Sqoop import --connect jdbc:mysql://mysql.example.com/sqoop --username sqoop --password sqoop --warehouse-dir user/hue/oozie/deployments/sqoop

Spark import --connect jdbc:mysql://mysql.example.com/spark --username spark --password spark --warehouse-dir user/hue/oozie/deployments/spark

Answer

Correct Answer: Sqoop import --connect jdbc:mysql://mysql.example.com/sqoop --username sqoop --password sqoop --warehouse-dir user/hue/oozie/deployments/sqoop

Note: This Question is unanswered, help us to find answer for this one

38. Skip bad records provides an option where a certain set of bad input records can be skipped when processing what type of data?

Cache inputs

Reducer inputs

Intermediate values

Map inputs

Answer

Correct Answer: Map inputs

Note: This Question is unanswered, help us to find answer for this one

39. To reference a master file for lookups during Mapping, what type of cache should be used?

Distributed cache

Local cache

Partitioned cache

Cluster cache

Answer

Correct Answer: Distributed cache

Note: This Question is unanswered, help us to find answer for this one

40. In a MapReduce job, where does the map() function run?

On the reducer nodes of the cluster

On the data nodes of the cluster (NOT SURE)

On the master node of the cluster

On every node of the cluster

Answer

Correct Answer: On the data nodes of the cluster (NOT SURE)

Note: This Question is unanswered, help us to find answer for this one

41. Which method is used to implement Spark jobs?

On disk of all workers

On disk of the master node

In memory of the master node

In memory of all workers

Answer

Correct Answer: In memory of all workers

Note: This Question is unanswered, help us to find answer for this one

42. DataNode supports which type of drives?

Hot swappable

Cold swappable

Warm swappable

Non-swappable

Answer

Correct Answer: Hot swappable

Note: This Question is unanswered, help us to find answer for this one

43. For high availability, use multiple nodes of which type?

Data

Name

Memory

Worker

Answer

Correct Answer: Name

Note: This Question is unanswered, help us to find answer for this one

44. To set up Hadoop workflow with synchronization of data between jobs that process tasks both on disk and in memory, use the _ service, which is _.

Oozie; open source

Oozie; commercial software

Zookeeper; commercial software

Zookeeper; open source

Answer

Correct Answer: Zookeeper; open source

Note: This Question is unanswered, help us to find answer for this one

45. What are the primary phases of a Reducer?

Combine, map, and reduce

Shuffle, sort, and reduce

Reduce, sort, and combine

Map, sort, and combine

Answer

Correct Answer: Shuffle, sort, and reduce

Note: This Question is unanswered, help us to find answer for this one

46. Hadoop Core supports which CAP capabilities?

A, P

C, A

C, P

C, A, P

Answer

Correct Answer: A, P

Note: This Question is unanswered, help us to find answer for this one

47. To get the total number of mapped input records in a map job task, you should review the value of which counter?

FileInputFormatCounter

FileSystemCounter

JobCounter

TaskCounter (NOT SURE)

Answer

Correct Answer: TaskCounter (NOT SURE)

Note: This Question is unanswered, help us to find answer for this one

48. Which line of code implements a Reducer method in MapReduce 2.0?

Public void reduce(Text key, Iterator values, Context context){…}

Public static void reduce(Text key, IntWritable[] values, Context context){…}

Public static void reduce(Text key, Iterator values, Context context){…}

Public void reduce(Text key, IntWritable[] values, Context context){…}

Answer

Correct Answer: Public void reduce(Text key, Iterator values, Context context){…}

Note: This Question is unanswered, help us to find answer for this one

49. To verify job status, look for the value _ in the _.

SUCCEEDED; syslog

SUCCEEDED; stdout

DONE; syslog

DONE; stdout

Answer

Correct Answer: SUCCEEDED; stdout

Note: This Question is unanswered, help us to find answer for this one

50. To perform local aggregation of the intermediate outputs, MapReduce users can optionally specify which object?

Reducer

Combiner

Mapper

Counter

Answer

Correct Answer: Combiner

Note: This Question is unanswered, help us to find answer for this one

51. MapReduce jobs can be written in which language?

Java or Python

SQL only

SQL or Java

Python or SQL

Answer

Correct Answer: Java or Python

Note: This Question is unanswered, help us to find answer for this one

52. Hadoop Auth enforces authentication on protected resources. Once authentication has been established, it sets what type of authenticating cookie?

Encrypted HTTP

Unsigned HTTP

Compressed HTTP

Signed HTTP

Answer

Correct Answer: Signed HTTP

Note: This Question is unanswered, help us to find answer for this one

53. Rather than adding a Secondary Sort to a slow Reduce job, it is Hadoop best practice to perform which optimization?

Add a partitioned shuffle to the Map job.

Add a partitioned shuffle to the Reduce job.

Break the Reduce job into multiple, chained Reduce jobs.

Break the Reduce job into multiple, chained Map jobs.

Answer

Correct Answer: Add a partitioned shuffle to the Reduce job.

Note: This Question is unanswered, help us to find answer for this one

54. SQL Windowing functions are implemented in Hive using which keywords?

UNION DISTINCT, RANK

OVER, RANK

OVER, EXCEPT

UNION DISTINCT, RANK

Answer

Correct Answer: OVER, RANK

Note: This Question is unanswered, help us to find answer for this one

55. Partitioner controls the partitioning of what data?

Final keys

Final values

Intermediate keys

Intermediate values

Answer

Correct Answer: Intermediate keys

Note: This Question is unanswered, help us to find answer for this one

56. The hadoop framework consists of the ________ algorithm to solve large scale problems.

MapSystem

MapReduce

MapCluster

MapComponent

Answer

Correct Answer: MapReduce

Note: This Question is unanswered, help us to find answer for this one

57. Which of the following operators is used for un-nesting the nested tuples and bags?

ILLUSTRATE

FLATTEN

COGROUP

CROSS

Answer

Correct Answer: FLATTEN

Note: This Question is unanswered, help us to find answer for this one

58. Which of the following is the correct syntax for resetting the space quota for directories in HDFS?

hdfs dfsadmin SpaceQuota <Quota> <dir1>…. <dirn>

hdfs dfsadmin -setQuota <Quota> <dir1>…. <dirn>

hdfs dfsadmin -clrSpaceQuota <dir1>…. <dirn>

hdfs dfsadmin -clrQuota <dir1>…. <dirn>

Answer

Correct Answer: hdfs dfsadmin -clrSpaceQuota <dir1>…. <dirn>

Note: This Question is unanswered, help us to find answer for this one

59. Which of the following objects is used by the RecordReader class for reading data from an InputSplit class?

FSDataInputStream

LineReader

FileSystem

RecordReader

Answer

Correct Answer: FSDataInputStream

Note: This Question is unanswered, help us to find answer for this one

60. Which of the following is the correct data type of the "totalMB" element of the clusterMetrics object used in the YARN ResourceManager REST API?

int

string

long

bigint

Answer

Correct Answer: long

Note: This Question is unanswered, help us to find answer for this one

61. Which of the following are NOT the properties of the app (Application) object of NodeManager REST API?

containerids

containers

state

user

app

Answer

Correct Answer: containers

Note: This Question is unanswered, help us to find answer for this one

62. Which of the following Hadoop DFSAdmin commands generates a list of DataNodes?

bin/hdfs dfsadmin −r

bin/hdfs dfsadmin −report

bin/hdfs dfsadmin −report DataNodes

bin/hdfs dfsadmin −r DataNodes

Answer

Correct Answer: bin/hdfs dfsadmin −report

Note: This Question is unanswered, help us to find answer for this one

63. Which of the following Hadoop commands is used for copying a source path to stdout?

stat

copyToLocal

cat

Answer

Correct Answer: cat

Note: This Question is unanswered, help us to find answer for this one

64. In case of a Multiquery execution, which of the following return codes indicates retrievable errors for an execution?

Answer

Correct Answer: 1

Note: This Question is unanswered, help us to find answer for this one

65. What is the default value of the hadoop.http.authentication.token.validity property that is used in case of authentication via HTTP interface?

72,000 seconds

18,000 seconds

64,000 seconds

36,000 seconds

Answer

Correct Answer: 36,000 seconds

Note: This Question is unanswered, help us to find answer for this one

66. While accessing a Hadoop Auth protocol URL using curl, which of the following command options are used for storing and sending HTTP cookies?

−u and -V

−b and −c

−c and −u

−u and −c

Answer

Correct Answer: −b and −c

Note: This Question is unanswered, help us to find answer for this one

67. Which of the following commands is used for distributing an excluded file to all the Namenodes?

[hdfs]$ $HADOOP_PREFIX/sbin/distribute-exclude.sh <exclude_file>

$[Hadoop hdfs] sbin/distribute-exclude.sh <exclude_file>

$[dfsadmin, hdfs] $HADOOP_PREFIX/sbin/<exclude_file>/ distribute-exclude.sh

[dfsadmin]$ $HADOOP_PREFIX/sbin/ <exclude_file>/ distribute-exclude.sh

Answer

Correct Answer: [hdfs]$ $HADOOP_PREFIX/sbin/distribute-exclude.sh <exclude_file>

Note: This Question is unanswered, help us to find answer for this one

68. Which of the following functions is NOT performed by the InputFormat class for a MapReduce Hadoop job?

It splits the input data into logical chunks and assigns each of these splits to a map task.

It instantiates the RecordReader object that can work on each InputSplit class.

It presents a record view of the data to the Map task and reads from an InputSplit class.

It produces the records to the Map task as key-value pairs.

Answer

Correct Answer: It presents a record view of the data to the Map task and reads from an InputSplit class.

Note: This Question is unanswered, help us to find answer for this one

69. Which of the following is the Hadoop directory service that stores the metadata related to the files present in the cluster storage?

MapReduce

DataNode

QuorumPeerMain

NameNode

Answer

Correct Answer: NameNode

Note: This Question is unanswered, help us to find answer for this one

70. Which of the following are the required command line arguments for the oev command of HDFS?

-i, --inputFile arg

-o, --outputFile arg

-p, --processor arg

-f, --fix-txids

Answer

Correct Answer: -i, --inputFile arg

Note: This Question is unanswered, help us to find answer for this one

71. Which of the following HDFS shell commands is used for setting a group for a particular file or directory?

chown

chmod

chgrp

setOwner

Answer

Correct Answer: chown

Note: This Question is unanswered, help us to find answer for this one

72. While configuring HTTP authentication in Hadoop, which of the following is set as the value of the "hadoop.http.filter.initializers" property?

org.apache.hadoop.security.AuthenticationInitializer class name

org.apache.hadoop.security.ShellBasedUnixGroupsMapping class name

org.apache.hadoop.security.LdapGroupsMapping class

org.apache.hadoop.security.ssl class name

Answer

Correct Answer: org.apache.hadoop.security.AuthenticationInitializer class name

Note: This Question is unanswered, help us to find answer for this one

73. What is the default value of the following security configuration property of the YARN architecture?
yarn.timeline-service.delegation.token.renew-interval

1 day

3 days

5 days

7 days

Answer

Correct Answer: 1 day

Note: This Question is unanswered, help us to find answer for this one

74. In case of service-level authorization in Hadoop, which of the following properties is used for determining the ACEs used for granting permissions for the DataNodes to communicate and access the NameNode?

security.client.datanode.protocol.acl

security.namenode.protocol.acl

security.client.protocol.acl

security.datanode.protocol.acl

Answer

Correct Answer: security.datanode.protocol.acl

Note: This Question is unanswered, help us to find answer for this one

75. Which of the following is the correct syntax for the docs Maven profile that is used for creating documentation in Hadoop Auth?

$ mvn package − Pdocs

$ mvn Pdocs

$ curl − mvn Pdocs

$ curl − mvn Pdocs − package

Answer

Correct Answer: $ mvn package − Pdocs

Note: This Question is unanswered, help us to find answer for this one

76. Which of the following Pig commands is/are used for sampling a data and applying a query on it?

DESCRIBE

ILLUSTRATE

EXPLAIN

Both a and b

Answer

Correct Answer: ILLUSTRATE

Note: This Question is unanswered, help us to find answer for this one

77. Which of the following HDFS commands is used for setting an extended attribute name and value for a file or a directory?

setgid

setFile

setfattr

setQuota

setConf

Answer

Correct Answer: setfattr

Note: This Question is unanswered, help us to find answer for this one

78. Which of the following configuration properties of YARNs Resource Manager is used for specifying the host:port for clients to submit jobs?

yarn.resourcemanager.ha.rm-ids

yarn.resourcemanager.address.rm-id

yarn.resourcemanager.hostname.rm-id

yarn.resourcemanager.scheduler.address.rm-id

Answer

Correct Answer: yarn.resourcemanager.address.rm-id

Note: This Question is unanswered, help us to find answer for this one

79. Which of the given options is the correct function of the following HiveQL command?
!

It is used for executing a dfs command from the Hive shell.

It is used for executing a shell command inside the CLI.

It is used for executing a shell command from the Hive shell.

It is used for executing a dfs command inside the CLI.

Answer

Correct Answer: It is used for executing a shell command from the Hive shell.

Note: This Question is unanswered, help us to find answer for this one

80. Which of the following HiveQL commands is used for printing the list of configuration variables overridden by Hive or the user?

set

set −v

dfs

reset

Answer

Correct Answer: set

Note: This Question is unanswered, help us to find answer for this one

81. In order to execute a custom, user-built JAR file, the jar command is used. Which of the following is the correct syntax of this command?

yarn node -jar [main class name] <jar file path>[arguments…]

yarn jar <jar file path> [main class name] [arguments…]

yarn application -jar [main class name] <jar file path> [arguments…]

yarn logs jar <jar file path> [main class name] [arguments…]

Answer

Correct Answer: yarn jar <jar file path> [main class name] [arguments…]

Note: This Question is unanswered, help us to find answer for this one

82. Which of the following commands is used for creating a keytab file used in Kerberos authentication?

kinit

klist

ktutil

mradmin

dfsadmin

Answer

Correct Answer: ktutil

Note: This Question is unanswered, help us to find answer for this one

83. Which of the following join operations are NOT supported by Hive?

Left semi-join

Inner join

Theta join

Fuzzy join

Answer

Correct Answer: Theta join

Note: This Question is unanswered, help us to find answer for this one

84. Which of the following permission levels is NOT allowed in HDFS authorization?

Read

Write

Execute

All three permission levels are allowed

Answer

Correct Answer: Execute

Note: This Question is unanswered, help us to find answer for this one

85. For a file named abc, which of the following Hadoop commands is used for setting all the permissions for owner, setting read permissions for group, and setting no permissions for other users in the system?

hadoop fs −chmod abc 310

hadoop fs −chmod 740 abc

hadoop fs ∼chmod 420 abc

hadoop fs −chmod abc ∼ 860

Answer

Correct Answer: hadoop fs −chmod 740 abc

Note: This Question is unanswered, help us to find answer for this one

86. Which of the following are the advantages of the disk-level encryption in HDFS?

It provides high performance.

It can be deployed easily.

It is highly flexible.

It can protect against software as well as physical threats.

Answer

Correct Answer: It provides high performance.

Note: This Question is unanswered, help us to find answer for this one

87. Which of the following commands is used for setting an environment variable in a streaming command?

-file ABC =/home/example/

−mapper ABC = /home/inputReader/example/dictionaries/

−input ABC = /home/directories/example

-cmdenv ABC = /home/example/dictionaries/

Answer

Correct Answer: -cmdenv ABC = /home/example/dictionaries/

Note: This Question is unanswered, help us to find answer for this one

88. Which two of the following parameters of the Hadoop streaming command are optional?

−output directoryname

−cmdenv name = value

−combiner streamingCommand

−reducer JavaClassName

Answer

Correct Answer: −cmdenv name = value

Note: This Question is unanswered, help us to find answer for this one

89. Which of the following statements is correct about YARNs Web Application Proxy?

It prevents the Application Manager from providing links to the malicious external sites.

It prevents the execution of the malicious JavaScript code.

It strips the cookies from the user and replaces them with a single cookie, providing the user name of the logged in user.

It runs as a part of Resource Manger but cannot be configured to run in the stand-alone mode.

Answer

Correct Answer: It strips the cookies from the user and replaces them with a single cookie, providing the user name of the logged in user.

Note: This Question is unanswered, help us to find answer for this one

90. Which two of the following are the correct differences between MapReduce and traditional RDBMS?

The scaling in MapReduce is non-linear, whereas in RDBMS it is linear.

In MapReduce, the read operation can be performed many times but the write operation can be performed only once. In traditional RDBMS, both read and write operations can be performed many times.

The integrity of MapReduce is higher as compared to RDBMS.

The access pattern of MapReduce is Batch, whereas the access pattern of RDBMS is Interactive and Batch

Answer

Correct Answer: In MapReduce, the read operation can be performed many times but the write operation can be performed only once. In traditional RDBMS, both read and write operations can be performed many times.

Note: This Question is unanswered, help us to find answer for this one

91. What is the function of the following Configuration property of YARNs Resource Manager?
yarn.resourcemanager.ha.id

It is used for identifying the class to be used by the client.

It used for listing the logical ID's used by Resource Managers.

It is used for specifying the corresponding host name for Resource Manager.

It is used for identifying the Resource Manager in ensemble.

Answer

Correct Answer: It is used for identifying the Resource Manager in ensemble.

Note: This Question is unanswered, help us to find answer for this one

92. Consider an input file named abc.dat.txt with default block size 128 MB. Which of the following is the correct command that will upload this file into an HDFS, with a block size of 512 MB?

hadoop fs ∼ D blocksize=536870912 -put abc.dat.txt to abc.dat.newblock.txt

hadoop fs.blocksize=536870912 -put abc.dat.txt abc.dat.newblock.txt

hadoop fs -D dfs.blocksize=536870912 -put abc.dat.txt abc.dat.newblock.txt

hadoop fs.blocksize −D=536870912 -put abc.dat.txt to abc.dat.newblock.txt

Answer

Correct Answer: hadoop fs -D dfs.blocksize=536870912 -put abc.dat.txt abc.dat.newblock.txt

Note: This Question is unanswered, help us to find answer for this one

93. Which of the following Hadoop commands is used for creating a file of zero length?

touchz

tail

text

test

Answer

Correct Answer: touchz

Note: This Question is unanswered, help us to find answer for this one

94. Which of the following statements is correct about the Hadoop file system namespace?

User access permission is not implemented in HDFS.

In HDFS, a user is not allowed to create directories.

HDFS supports hard links.

HDFS implements user quotas.

Answer

Correct Answer: User access permission is not implemented in HDFS.

Note: This Question is unanswered, help us to find answer for this one

95. Suppose you need to select a storage system that supports Resource Manager High Availability (RM HA). Which of the following types of storage should be selected in this case?

LevelDB based state-store

FileSystem based state-store

Zookeeper based state-store

Either option a or b could be used

Answer

Correct Answer: Zookeeper based state-store

Note: This Question is unanswered, help us to find answer for this one

96. Which of the following is used for changing the group of a file?

hdfs chgrp [owner] [:[group] ] [-R] <filepath><newgroup>

hdfs chgrp [-R] <group> <filepath>

hdfs chgrp [-R] <[group[: [owner]> <filepath>

hdfs chgrp <group> <filepath>[-R] <newgroup>

hdfs chgrp <group>[-R] <newgroup>

Answer

Correct Answer: hdfs chgrp [-R] <group> <filepath>

Note: This Question is unanswered, help us to find answer for this one

97. Which of the following statements is correct about the Hive joins?

The joins in Hive are commutative.

In Hive, more than two tables can be joined.

The first table participating in the join is streamed to the reduce task by default.

All are correct.

Answer

Correct Answer: In Hive, more than two tables can be joined.

Note: This Question is unanswered, help us to find answer for this one

98. Which of the following is the correct line command syntax of the Hadoop streaming command?

hadoop command [streamingOptions]

command ∼ Hadoop [genericOptions] [streamingOptions]

hadoop command [genericOptions] [streamingOptions]

command ∼ Hadoop [streamingOptions] [genericOptions]

Answer

Correct Answer: hadoop command [genericOptions] [streamingOptions]

Note: This Question is unanswered, help us to find answer for this one

99. Which of the following operators is necessary to be used for theta-join?

Cogroup

Foreach

Cross

Union

Answer

Correct Answer: Cross

Note: This Question is unanswered, help us to find answer for this one

100. Which of the following are the characteristics of the UNION operator of Pig?

It does not impose any restrictions on the schema of the two datasets that are being concatenated.

It removes the duplicate tuples while concatenating the datasets.

It preserves the ordering of the tuples while concatenating the datasets.

It uses the ONSCHEMA qualifier for giving a schema to the result

Answer

Correct Answer: It does not impose any restrictions on the schema of the two datasets that are being concatenated.

Note: This Question is unanswered, help us to find answer for this one

101. Which of the following functions is performed by the Scheduler of Resource Manager in the YARN architecture?

It provides insights on the status of the application.

It guarantees the restart on the application and hardware failures.

It allocates resources to the applications running in the cluster.

It handles the applications submitted by the clients.

Answer

Correct Answer: It allocates resources to the applications running in the cluster.

Note: This Question is unanswered, help us to find answer for this one

102. Which of the given Pig data types has the following characteristics?
i) It is a collection of data values.
ii) These data values are ordered and have a fixed length.

bytearray

Bag

Map

Tuple

Answer

Correct Answer: Tuple

Note: This Question is unanswered, help us to find answer for this one

103. In which of the following Pig execution modes, a Java program is capable of invoking Pig commands by importing the Pig libraries?

Interactive mode

Batch mode

Embedded mode

Either Interactive or Batch mode

Answer

Correct Answer: Embedded mode

Note: This Question is unanswered, help us to find answer for this one

104. Which of the given options is the function of the following Hadoop command?
-a

It is used for checking whether all the libraries are available.

It is used for expanding the wildcards.

It is used for specifying a resource manager.

It is used for assigning a value to a property

Answer

Correct Answer: It is used for checking whether all the libraries are available.

Note: This Question is unanswered, help us to find answer for this one

105. Which of the following Hive commands is used for creating a database named MyData?

CREATE MyData DATABASE

CREATE DATABASE MyData

CREATE NEW MyData DATABASE

CREATE NEW DATABASE MyData

Answer

Correct Answer: CREATE DATABASE MyData

Note: This Question is unanswered, help us to find answer for this one

106. Which of the following Hive clauses should be used for imposing a total order on the query results?

ORDER BY

SORT BY

Either a or b

None of the above

Answer

Correct Answer: SORT BY

Note: This Question is unanswered, help us to find answer for this one

107. Which of the following interfaces can decrease the amount of memory required by UDFs, by accepting the input in chunks?

PigReducerEstimator interface

StoreFunc interface

FilterFunc interface

Accumulator interface

Answer

Correct Answer: Accumulator interface

Note: This Question is unanswered, help us to find answer for this one

108. Before being inserted to a disk, the intermediate output records emitted by the Map task are buffered in the local memory, using a circular buffer. Which of the following properties is used to configure the size of this circular buffer?

mapreduce.task.io.sort.mb

io.record.sort.percent

mapreduce.partitioner.class

mapreduce.task.io.mb

Answer

Correct Answer: mapreduce.task.io.sort.mb

Note: This Question is unanswered, help us to find answer for this one

109. In Hadoop, HDFS snapshots are taken for which of the following reasons?
i) For providing protection against user error.
ii) For providing backup.
iii) For disaster recovery.
iv) For copying data from data nodes.

Only i) and iii)

Only ii) and iv)

Only i), ii), and iii)

Only i), iii), and iv)

All i), ii), iii), and iv)

Answer

Correct Answer: Only i), ii), and iii)

Note: This Question is unanswered, help us to find answer for this one

110. What is the function of the following Hadoop command?
du

It displays the summary of file lengths.

In case of a file, it displays the length of the file, while in case of a directory, it displays the sizes of the files and directories present in that directory.

It displays the number of files in a particular directory.

It displays the numbers and names of files present in a particular directory.

Answer

Correct Answer: In case of a file, it displays the length of the file, while in case of a directory, it displays the sizes of the files and directories present in that directory.

Note: This Question is unanswered, help us to find answer for this one

111. Which of the following interfaces is used for accessing the Hive metastore?

Transform

Command Line

ObjectInspector

Thrift

Answer

Correct Answer: Thrift

Note: This Question is unanswered, help us to find answer for this one

112. Which of the following commands is used to view the content of a file named /newexample/example1.txt?

bin/hdfs dfs −cat /newexample/example1.txt

bin/hadoop dfsadmin -ddir /newexample/example1.txt

bin/hadoop dfs -cat /newexample/example1.txt

bin/hdfs dfsadmin -ddir /newexample/example1.txt

Answer

Correct Answer: bin/hadoop dfs -cat /newexample/example1.txt

Note: This Question is unanswered, help us to find answer for this one

113. Which of the following HDFS commands is used for checking inconsistencies and reporting problems with various files?

fetchdt

dfs

oiv

fsck

Answer

Correct Answer: fsck

Note: This Question is unanswered, help us to find answer for this one

114. Which of the following environment variables is used for determining the Hadoop cluster for Pig, in order to run the MapReduce jobs?

YARN_CONF_DIR

HADOOP_PREFIX

HADOOP_CONF_DIR

HADOOP_HOME

Answer

Correct Answer: HADOOP_CONF_DIR

Note: This Question is unanswered, help us to find answer for this one

115. Which of the following is the master process that accepts the job submissions from the clients and schedule the tasks to run on worker nodes?

Tasktracker

Jobtracker

YARN

Node Manager

Answer

Correct Answer: Jobtracker

Note: This Question is unanswered, help us to find answer for this one

116. In Pig, which of the following types of join operations can be performed using the Replicated join?
i) Inner join
ii) Outer join
iii) Right-outer join
iv) Left-outer join

Only i) and ii)

Only ii) and iii)

Only i) and iv)

Only iii) and iv)

Only i), ii), and iii)

Answer

Correct Answer: Only i) and iv)

Note: This Question is unanswered, help us to find answer for this one

117. Which of the following is the correct syntax for the command used for setting replication for an existing file in Hadoop WebHDFS REST API?

setReplication(string replication, Path p, FsPermission permission)

setReplication(FsPermission permission, short replication)

setReplication(string replication, Path p)

setReplication(Path src, short replication)

Answer

Correct Answer: setReplication(Path src, short replication)

Note: This Question is unanswered, help us to find answer for this one

Hadoop MCQs | Topic-wise

MCQ on Basic Hadoop

General Hadoop MCQs

Buy us a coffee

Hadoop Subjects

More Resources

Hadoop MCQ

Hadoop Skill Assessment

Hadoop PDF

Related MCQs

Hibernate MCQs

HTML MCQs

HTML 5 MCQs

Information Technology (IT) MCQs

Internet Security MCQs

Basic Hadoop MCQ

1. To copy a file into the Hadoop file system, what command should you use?

2. What kind of storage and processing does Hadoop support?

3. Which file system does Hadoop use for storage?

4. Hadoop Common is written in which language?

5. Which feature is used to roll back a corrupted HDFS instance to a previously known good point in time?

6. To view the execution details of an Impala query plan, which function would you use ?

7. Which object can be used to distribute jars or libraries for use in MapReduce tasks?

8. Hadoop systems are _ RDBMS systems.

9. Where would you configure the size of a block in a Hadoop environment?

10. In a MapReduce job, which phase runs after the Map phase completes?

11. Suppose you are trying to finish a Pig script that converts text in the input string to uppercase. What code is needed on line 2 below? 1 data = LOAD '/user/hue/pig/examples/data/midsummer.txt'... 2

12. Which type of Hadoop node executes file system namespace operations like opening, closing, and renaming files and directories?

13. MapReduce 1.0 _ YARN

14. _ is the query language, and _ is storage for NoSQL on Hadoop

15. MapReduce applications use which of these classes to report their statistics?

16. If no reduction is desired, you should set the numbers of _ tasks to zero

17. What type of software is Hadoop Common?

18. In MapReduce, _ have _

19. Hadoop 2.x and later implement which service as the resource coordinator?

20. To implement high availability, how many instances of the master node should you configure?

21. Which Hive query returns the first 1,000 values?

22. To what does the Mapper map input key/value pairs?

23. In what format does RecordWriter write an output file?

24. In the Hadoop system, what administrative mode is used for maintenance?

25. When implemented on a public cloud, with what does Hadoop processing interact?

26. What is the output of the Reducer?

27. Which library should you use to perform ETL-type MapReduce jobs?

28. A distributed cache file path can originate from what location?

29. HDFS file are of what type?

30. HBase works with which type of schema enforcement?

31. To connect Hadoop to AWS S3, which client should you use?

32. To create a MapReduce job, what should be coded first?

33. State _ between the JVMs in a MapReduce job

34. If you started the NameNode, then which kind of user must you be?

35. Which library should be used to unit test MapReduce code?

36. In what form is Reducer output presented?

37. Which command imports data to Hadoop from a MySQL database?

38. Skip bad records provides an option where a certain set of bad input records can be skipped when processing what type of data?

39. To reference a master file for lookups during Mapping, what type of cache should be used?

40. In a MapReduce job, where does the map() function run?

41. Which method is used to implement Spark jobs?

42. DataNode supports which type of drives?

43. For high availability, use multiple nodes of which type?

44. To set up Hadoop workflow with synchronization of data between jobs that process tasks both on disk and in memory, use the ___ service, which is ___.

45. What are the primary phases of a Reducer?

46. Hadoop Core supports which CAP capabilities?

47. To get the total number of mapped input records in a map job task, you should review the value of which counter?

48. Which line of code implements a Reducer method in MapReduce 2.0?

49. To verify job status, look for the value ___ in the ___.

50. To perform local aggregation of the intermediate outputs, MapReduce users can optionally specify which object?

51. MapReduce jobs can be written in which language?

52. Hadoop Auth enforces authentication on protected resources. Once authentication has been established, it sets what type of authenticating cookie?

53. Rather than adding a Secondary Sort to a slow Reduce job, it is Hadoop best practice to perform which optimization?

54. SQL Windowing functions are implemented in Hive using which keywords?

55. Partitioner controls the partitioning of what data?

56. The hadoop framework consists of the ________ algorithm to solve large scale problems.

57. Which of the following operators is used for un-nesting the nested tuples and bags?

58. Which of the following is the correct syntax for resetting the space quota for directories in HDFS?

59. Which of the following objects is used by the RecordReader class for reading data from an InputSplit class?

60. Which of the following is the correct data type of the "totalMB" element of the clusterMetrics object used in the YARN ResourceManager REST API?

61. Which of the following are NOT the properties of the app (Application) object of NodeManager REST API?

62. Which of the following Hadoop DFSAdmin commands generates a list of DataNodes?

63. Which of the following Hadoop commands is used for copying a source path to stdout?

64. In case of a Multiquery execution, which of the following return codes indicates retrievable errors for an execution?

65. What is the default value of the hadoop.http.authentication.token.validity property that is used in case of authentication via HTTP interface?

66. While accessing a Hadoop Auth protocol URL using curl, which of the following command options are used for storing and sending HTTP cookies?

67. Which of the following commands is used for distributing an excluded file to all the Namenodes?

68. Which of the following functions is NOT performed by the InputFormat class for a MapReduce Hadoop job?

69. Which of the following is the Hadoop directory service that stores the metadata related to the files present in the cluster storage?

70. Which of the following are the required command line arguments for the oev command of HDFS?

71. Which of the following HDFS shell commands is used for setting a group for a particular file or directory?

72. While configuring HTTP authentication in Hadoop, which of the following is set as the value of the "hadoop.http.filter.initializers" property?

73. What is the default value of the following security configuration property of the YARN architecture?yarn.timeline-service.delegation.token.renew-interval

74. In case of service-level authorization in Hadoop, which of the following properties is used for determining the ACEs used for granting permissions for the DataNodes to communicate and access the NameNode?

75. Which of the following is the correct syntax for the docs Maven profile that is used for creating documentation in Hadoop Auth?

76. Which of the following Pig commands is/are used for sampling a data and applying a query on it?

77. Which of the following HDFS commands is used for setting an extended attribute name and value for a file or a directory?

78. Which of the following configuration properties of YARNs Resource Manager is used for specifying the host:port for clients to submit jobs?

79. Which of the given options is the correct function of the following HiveQL command?!

44. To set up Hadoop workflow with synchronization of data between jobs that process tasks both on disk and in memory, use the _ service, which is _.

49. To verify job status, look for the value _ in the _.

73. What is the default value of the following security configuration property of the YARN architecture?
yarn.timeline-service.delegation.token.renew-interval

79. Which of the given options is the correct function of the following HiveQL command?
!

91. What is the function of the following Configuration property of YARNs Resource Manager?
yarn.resourcemanager.ha.id

102. Which of the given Pig data types has the following characteristics?
i) It is a collection of data values.
ii) These data values are ordered and have a fixed length.

104. Which of the given options is the function of the following Hadoop command?
-a

109. In Hadoop, HDFS snapshots are taken for which of the following reasons?
i) For providing protection against user error.
ii) For providing backup.
iii) For disaster recovery.
iv) For copying data from data nodes.

110. What is the function of the following Hadoop command?
du

116. In Pig, which of the following types of join operations can be performed using the Replicated join?
i) Inner join
ii) Outer join
iii) Right-outer join
iv) Left-outer join