Hadoop Development Tools by Karmasphere

in episode #5 of the hadoop podcast http://allthingshadoop.com/podcast/ i speak with shevek, the cto of karmasphere http://karmasphere.com/ .  to subscribe to the podcast click here .

we talk a bit about their existing community edition (support netbeans & eclipse)

• for developing, debugging and deploying hadoop jobs
• desktop mapreduce prototyping
• gui to manipulate clusters, file systems and jobs
• easy deployment to any hadoop version, any distribution in any cloud
• works through firewalls

as well as the new products they have launched:

karmasphere client:

the karmasphere client is a cross platform library for ensuring mapreduce jobs can work from any desktop environment to any hadoop cluster in any enterprise data network. by isolating the big data professional and version of hadoop, karmasphere client simplifies the process of switching between data centers and the cloud and enables hadoop jobs to be independent of the version of the underlying cluster.

unlike the standard hadoop client , karmasphere client works from microsoft windows as well as linux and macos, and works through ssh-based firewalls. karmasphere client provides a cloud-independent environment that makes it easy and predictable to maintain a business operation reliant on hadoop.

• ensures hadoop distribution and version independence
• works from windows (unlike hadoop client)
• supports any cloud environment: public, private or public cloud service.
• provides:
  • job portability
  • operating system portability
  • firewall hopping
  • fault tolerant api
  • synchronous and asynchronous api
  • clean object oriented design
• making it easy and predictable to maintain a business operation reliant on hadoop

karmasphere studio professional edition

karmasphere studio professional edition includes all the functionality of the community edition, plus a range of deeper functionality required to simplify the developer’s task of making a mapreduce job robust, efficient and production-ready.

for a mapreduce job to be robust, its functioning on the cluster has to be well understood in terms of time, processing, and storage requirements, as well as in terms of its behavior when implemented within well-defined “bounds.” karmasphere studio professional edition incorporates the tools and a predefined set of rules that make it easy for the developer to understand how his or her job is performing on the cluster and where there is room for improvement.

• enhanced cluster visualization and debugging
  • execution diagnostics
  • job performance timelines
  • job charting
  • job profiling
• job export
  • for easy production deployment
• support

karmasphere studio analyst edition

• sql interface for ad hoc analysis
• karmasphere application framework + hive + gui =
  • no cluster changes
  • works over proxies and firewalls
  • integrated hadoop monitoring interactive syntax checking
  • detailed diagnostics
  • enhanced schema browser
  • full jdbc4 compliance
  • multi-threaded & concurrent