VERIFIED SOLUTION i
X

Information regarding environment recommendations when setting up a cloud environment to run a Spectrum® Technology Platform Hadoop implementation

UPDATED: August 31, 2017


The following is a list of current recommendations to use as reference for setting up an AWS installation of Spectrum® Technology Platform for executing Big Data jobs:
  • 8 nodes of m4.4xlarge instances on AWS  (Note:  The m4.4xlarge AWS instance has 16 cores, 64GB of RAM, and 2TB of storage per node)
  • Cloudera release (currently 5.12)
  • CentOS 7 

Set up the cluster with the core components (HDFS, YARN, Zookeeper) as well as Hive and Spark.
 
It is best to have a “pbuser” with a home directory added to each server.  The Pitney Bowes SDKs can then be installed into that "pbuser" home directory.
 

Environment Details

Products affected:  Pitney Bowes Spectrum Technology Platform


 

Downloads

  • No Downloads