hadoop-book : Example source code accompanying O'Reilly's "Hadoop: The Definitive Guide" by Tom White
author: tomwhite
created: 2009-07-13 10:13:48
book hadoop o-reilly makefile


behemoth : Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.
author: DigitalPebble
created: 2010-06-15 16:39:09
hadoop java mapreduce nlp


hue : Hue is an open source SQL Cloud Assistant for developing and accessing SQL/Data Apps.
author: cloudera
created: 2010-06-21 19:46:51
dashboards data-analysis data-analytics datawarehouse editor hadoop hue query-builder sql python


asakusafw : Asakusa Framework
author: asakusafw
created: 2011-03-30 12:15:15
asakusa-framework batch batch-processing big-data data-flow framework hadoop java mapreduce


Phadoop : Map/reduce jobs for Hadoop in PHP
author: ihor
created: 2011-10-28 20:26:25
hadoop map-reduce php


splittablegzip : Splittable Gzip codec for Hadoop
author: nielsbasjes
created: 2012-03-28 21:59:15
codec gzip hadoop pig splittable java


hicloud-hadoop : install hadoop automatically to hiCloud VM in Taiwan
author: jazzwang
created: 2012-05-05 14:32:24
hadoop hicloud taiwan shell


thadoop : (deprecated) Thrift integration for Hadoop Writables
author: after-the-sunrise
created: 2012-06-09 12:23:29
hadoop hive mapreduce pig thrift java


fluent-plugin-webhdfs : Hadoop WebHDFS output plugin for Fluentd
author: fluent
created: 2012-07-13 18:47:31
fluentd fluentd-plugin hadoop hdfs ruby


presto : Distributed SQL query engine for big data
author: prestodb
created: 2012-08-09 01:03:37
big-data hadoop hive java presto sql


MrSim : A simple MapReduce framework in Java
author: sylvainhalle
created: 2012-11-24 18:21:42
hadoop java mapreduce tuples


alluxio : Alluxio, formerly Tachyon, Unify Data at Memory Speed
author: Alluxio
created: 2012-12-21 17:43:46
alluxio big-data distributed-storage hadoop memory-speed presto spark tensorflow virtual-file-system java


nagios-plugins : Hadoop, Docker, Kafka, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Ambari, Hortonworks, Cloudera, MapR, Neo4j, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Mesos, Riak, MongoDB, Memcached, Couchbase, CouchDB. Products: Attivio, Blue Talon, Datameer, H2O, WanDisco, Zaloni
author: HariSekhon
created: 2012-12-30 20:29:47
ambari cassandra cloudera consul datastax docker elasticsearch hadoop hbase hbase-client hortonworks jenkins kafka kubernetes nagios-plugins rabbitmq redis solr travis-ci zookeeper python


devops-perl-tools : DevOps CLI Tools for Hadoop, Hive, HDFS file/snapshot age out, Solr / SolrCloud CLI, Ambari FreeIPA Kerberos, Config / Log Anonymizer, URL watcher for load balanced web farms, SQL ReCaser (Hive, Impala, Cassandra CQL, Couchbase N1QL, MySQL, PostgreSQL, Apache Drill, Microsoft SQL Server, Oracle, Pig Latin, Neo4j, InfluxDB, Dockerfiles), Nginx stats watcher, Datameer, Linux tools...
author: HariSekhon
created: 2012-12-30 23:30:23
ambari anonymize apache-drill cassandra docker hadoop hbase hdfs hive kerberos linux mysql neo4j nginx oracle pig recaser solr solrcloud sql perl


gis-tools-for-hadoop : The GIS Tools for Hadoop are a collection of GIS tools for spatial analysis of big data.
author: Esri
created: 2013-03-13 19:41:30
hadoop spatial-analysis


big-data-exploration : [Archive] Intern project - Big Data Exploration using MongoDB - This Repository is NOT a supported MongoDB product
author: mongodb-labs
created: 2013-05-28 19:30:02
datasets hadoop java mongodb python javascript


hadoop-for-geoevent : ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.
author: Esri
created: 2013-06-14 23:03:56
arcgis arcgis-geoevent-server big-data bigdata connector geoevent hadoop hdfs java server transport


StormTweetsSentimentAnalysis : Computes sentiment analysis of tweets of US States in real-time using Storm.
author: P7h
created: 2013-06-16 23:29:21
hadoop java storm twitter-sentiment-analysis


avro-hadoop-starter : Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.
author: miguno
created: 2013-07-03 19:07:44
avro hadoop hive java mapreduce pig


storm-camel-example : Real-time analysis and visualization with Storm-AMQ-Camel-Websockets-Highcharts integration.
author: P7h
created: 2013-07-04 14:14:34
hadoop highcharts java storm websockets


TarFileSystem : The Tar FileSystem for Hadoop lives here
author: JDatta
created: 2013-08-31 04:38:45
hadoop java tar-archive tar-filesystem tar-uri


oozie-graphite : Monitor your oozie server and your oozie bundles with graphite
author: syscrest
created: 2013-09-12 09:27:29
cdh graphite hadoop hadoop-mapreduce java monitoring oozie


hadoop_cookbook : Cookbook to install Hadoop 2.0+ using Chef
author: cdapio
created: 2013-10-23 22:56:32
chef chef-cookbook cookbooks hadoop hadoop-cookbook hbase hive spark zookeeper ruby


deeplearning4j : Deeplearning4j, ND4J, DataVec and more - deep learning & linear algebra for Java/Scala with GPUs + Spark
author: deeplearning4j
created: 2013-11-27 02:03:28
artificial-intelligence clojure deeplearning deeplearning4j dl4j gpu hadoop intellij java linear-algebra matrix-library neural-nets python scala spark


IntroToHadoopAndMR__Udacity_Course : :elephant: Source code for assignments of Udacity course "Introduction to Hadoop and MapReduce"
author: P7h
created: 2013-11-27 16:16:12
hadoop java mooc python udacity-course


NeuralGiraph : Graph algorithm implemented with Apache Giraph for large-scale neural network simulation
author: imsure
created: 2013-12-05 19:53:38
giraph hadoop java mapreduce neural-network simulation


HadoopRayTracer : A toy ray-tracer based on Hadoop
author: flexwang
created: 2013-12-19 12:16:37
hadoop java ray-tracing-algorithm raytracer


likelike : An implementation of locality sensitive hashing with Hadoop
author: takahi-i
created: 2013-12-26 13:26:45
hadoop java lsh recommender-system


my-projects : Learn by doing projects
author: usunyu
created: 2014-01-19 23:44:23
android arkit blockchain cardboard django ffmpeg flutter gearvr hadoop ios lynda opengl react redux ruby-on-rails shader tutorial udemy unity3d unreal-engine c++


webhdfs : Node.js WebHDFS REST API client
author: harrisiirak
created: 2014-02-13 00:06:40
hadoop javascript node-webhdfs webhdfs


h2o-3 : Open Source Fast Scalable Machine Learning Platform For Smarter Applications (Deep Learning, Gradient Boosting, Random Forest, Generalized Linear Modeling (Logistic Regression, Elastic Net), K-Means, PCA, Stacked Ensembles, Automatic Machine Learning (AutoML), ...)
author: h2oai
created: 2014-03-03 16:08:07
automatic big-data data-science deep-learning distributed ensemble-learning gbm gpu h2o hadoop java machine-learning multi-threading naive-bayes opensource pca python r random-forest spark


jsr203-hadoop : A Java NIO file system provider for HDFS
author: damiencarol
created: 2014-03-19 14:31:47
hadoop hdfs java nio


StormTweetsSentimentD3Viz : Computes and visualizes the sentiment analysis of tweets of US States in real-time using Storm.
author: P7h
created: 2014-03-24 14:42:31
d3-visualization hadoop java storm twitter-sentiment-analysis


vagrant-hadoop : some vagrant examples for different hadoop cluster deployment model
author: jazzwang
created: 2014-04-04 03:21:53
aws cdh hadoop vagrant shell


shifu : An end-to-end machine learning and data mining framework on Hadoop
author: ShifuML
created: 2014-04-21 22:21:09
bigdata end-to-end-machine-learning gbdt hadoop machine-learning neural-network pipeline random-forest shifu java


guagua : An iterative computing framework for both Hadoop MapReduce and Hadoop YARN.
author: ShifuML
created: 2014-05-07 06:23:40
hadoop in-memory iterative machine-learning yarn java


cloudbreak : A tool for provisioning and managing Apache Hadoop clusters in the cloud. Cloudbreak, as part of the Hortonworks Data Platform, makes it easy to provision, configure and elastically grow HDP clusters on cloud infrastructure. Cloudbreak can be used to provision Hadoop across cloud infrastructure providers including AWS, Azure, GCP and OpenStack.
author: hortonworks
created: 2014-05-10 10:03:07
big-data cloud deployment hadoop hortonworks java


StormTweetsSentimentD3UKViz : Computes and visualizes the sentiment analysis of tweets of UK Counties / Regions in real-time using Storm.
author: P7h
created: 2014-05-19 07:19:09
d3-visualization hadoop java storm twitter-sentiment-analysis


hadoop-jobs : Web interface for Hadoop jobs
author: bbonnin
created: 2014-05-21 18:12:45
hadoop hadoop-mapreduce css


streamsx.hdfs : This toolkit provides operators and functions for interacting with Hadoop File System.
author: IBMStreams
created: 2014-05-22 15:57:47
hadoop hdfs ibm-streams java stream-processing


jumbune : Jumbune is an open-source Proactive ML based BigData platform performance accelerator & automated data quality management platform. Commercial offering is available at http://jumbune.com. More details of open source offering are at,
author: Impetus
created: 2014-06-05 15:28:30
cluster-monitoring data-analysis data-quality developer-tools devops-tools hadoop hadoop-cluster hadoop-monitor hadoop-monitoring monitoring-tool optimization-framework yarn yarn-hadoop-cluster java


ethz-web-scale-data-mining-project : ETH Zurich - Web Scale Data Processing and Mining Project
author: lukaselmer
created: 2014-06-10 18:09:27
big-data data-mining eth hadoop machine-learning scala spark topic-modeling web-scale html


WikipediaRank : Show the 10 most popular wikipedia pages by language
author: jessicaowensby
created: 2014-07-27 04:39:09
hadoop hive wikipedia java


docker-hadoop : docker related.
author: winse
created: 2014-10-02 16:19:28
docker hadoop k8s kubernetes shell


hive-jdbc-uber-jar : Hive JDBC "uber" or "standalone" jar based on the latest Hortonworks Data Platform (HDP)
author: timveil
created: 2014-10-10 12:59:59
driver hadoop hive hortonworks jdbc kerberos java


hadoop-pagerank : PageRank algorithm implementation which make use of the Apache Hadoop framework
author: danielepantaleone
created: 2014-10-31 19:29:04
algorithm hadoop java pagerank


fluo-uno : Uno (an Apache Fluo project) sets up Apache Accumulo or Apache Fluo on a single machine for development
author: apache
created: 2014-12-17 21:39:31
accumulo fluo hadoop uno zookeeper shell


hadoop-mini-clusters : hadoop-mini-clusters provides an easy way to test Hadoop projects directly in your IDE
author: sakserv
created: 2015-01-04 14:36:24
hadoop hadoop-mini-clusters ide java test-automation


sof : Simulation Optimization and exploration Framework on the cloud: SOF
author: isislab-unisa
created: 2015-01-08 15:06:17
agent-based-simulation hadoop java mapreduce optimization-process simulation-model simulation-optimization sof


fluo-muchos : Muchos (an Apache Fluo project) sets up Apache Accumulo or Apache Fluo on a cluster (optionally launched in Amazon EC2) for development
author: apache
created: 2015-01-21 13:23:09
accumulo amazon-ec2 fluo hadoop spark python


data-science-ipython-notebooks : Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
author: donnemartin
created: 2015-01-23 19:38:29
aws big-data caffe data-science deep-learning hadoop kaggle keras machine-learning mapreduce matplotlib numpy pandas python scikit-learn scipy spark tensorflow theano


camus : Mirror of Linkedin's Camus
author: confluentinc
created: 2015-01-27 04:58:55
camus confluent connector hadoop hdfs kafka java


hdp-vagrant-base : Base Vagrant file for Hortonworks Data Platform (HDP) instances
author: timveil
created: 2015-02-15 02:24:00
hadoop hortonworks vagrant shell


ni : Say "ni" to data of any size
author: spencertipping
created: 2015-02-22 20:56:20
big-data datascience hadoop perl pipeline ssh visualization


fuzzyjoin : Fork of http://asterixdb.ics.uci.edu/fuzzyjoin/ Efficient Parallel Set-Similarity Joins Using MapReduce. Rares Vernica, Michael J. Carey, Chen Li SIGMOD 2010
author: TonyApuzzo
created: 2015-03-04 14:45:15
hadoop hadoop-mapreduce mapreduce java


ParallelMetablocking : Parallel Meta-blocking in MapReduce
author: vefthym
created: 2015-03-29 14:53:49
blocking hadoop java linked-data mapreduce meta-blocking


bigdata_taxi_airquality : Using NYC Taxi Data as a Predictor of Urban Air Quality
author: stevecarrea
created: 2015-04-01 01:24:38
air-pollution air-quality hadoop mapreduce taxi-data python


ibis : A pandas-like deferred expression system, with first-class SQL support (Impala, PostgreSQL, SQLite, ...)
author: ibis-project
created: 2015-04-17 20:43:46
hadoop hdfs ibis impala pandas python


hdp-vagrant-generator : Vagrantfile generator for Hortonworks Data Platform (HDP)
author: timveil
created: 2015-04-18 20:58:49
hadoop hortonworks vagrant java


pig-tutorial : Instructions and sample datasets for the "big data" hands on lab presented at the 2015 Chicago Coders Conference.
author: defano
created: 2015-04-19 14:27:35
big-data hadoop hortonworks pig pig-latin pig-scripts piglatin


corc : An ORC File Scheme for the Cascading data processing platform.
author: HotelsDotCom
created: 2015-05-15 14:59:07
cascading hadoop orc-files java


kafka-connect-hdfs : Kafka Connect HDFS connector
author: confluentinc
created: 2015-05-20 18:54:34
apache-kafka big-data confluent hadoop hdfs kafka kafka-connect-hdfs kafka-connector streaming java


memex-gate : General Architecture for Text Engineering
author: nasa-jpl-memex
created: 2015-05-22 22:14:18
behemoth court entities federal gate hadoop information-retrieval lexicon memex named-entities named-entity-recognition text-engine python


camus-compressor : Camus Compressor merges files created by Camus and saves them in a compressed format.
author: allegro
created: 2015-06-18 12:15:30
avro etl hadoop kafka spark java


RecommendationEngine : [Deprecated] A creative recommendation engine based on Hadoop, powered by an efficient and high scalable implementation of item-based collaborative filtering recommendation algorithm.
author: tinylcy
created: 2015-06-22 03:30:25
collaborative-filtering hadoop recommendation-engine java


teraslice : Distributed computing platform for processing JSON data
author: terascope
created: 2015-07-21 23:09:13
elasticsearch hadoop hdfs json kafka typescript


graylog-plugin-output-webhdfs : WebHDFS Output plugin for Graylog
author: sivasamyk
created: 2015-07-27 18:23:31
archiving graylog graylog-plugin hadoop webhdfs java


floating-elephants : Docker containers for Hadoop.
author: trifacta
created: 2015-08-04 03:02:03
dns docker hadoop hadoop-distributions shell


yuzhouwan : Code Library for My Blog
author: asdf2014
created: 2015-08-04 06:32:09
algorithm bigdata druid elasticsearch hadoop hbase nio spark tensorflow zookeeper java


AssortmentOfJUnitRules : An assortment of (for me anyway) useful JUnit rules.
author: mlk
created: 2015-08-17 13:39:45
component-testing dynamodb dynamodb-local hacktoberfest hadoop integration-testing junit-rule mocking mongo s3 sftp-server spark stubbing java


big-data-lite : Samples to the Oracle Big Data Lite VM
author: oracle
created: 2015-08-20 02:43:32
big-data hadoop java


Relatorio-PIBITI-FUNTTEL-2015 : Classes e scripts utilizados para realização de experimentos durante o PIBITI em 2015 no LSD/UFCG. Trabalho realizado por: Marianne Linhares, orientada por: Andrey Brito.
author: mari-linhares
created: 2015-08-26 13:12:40
hadoop pibiti ufcg java


iis : Information Inference Service of the OpenAIRE system
author: openaire
created: 2015-09-11 05:55:08
big-data data-mining data-processing-system hadoop iis information-inference openaire spark text-mining java


docker-hadoop-cluster : Multiple node cluster on Docker for self development.
author: Lewuathe
created: 2015-09-13 14:22:41
docker hadoop shell


ParallelBlocking : Parallel Blocking in MapReduce
author: vefthym
created: 2015-09-17 08:09:07
blocking entity-resolution hadoop java linked-data mapreduce


Small_Dense_Subgraphs : A Hadoop java implementation of a MapReduce algorithm for finding small dense subgraphs from any big interconnection network represented as a graph
author: pa5h1nh0
created: 2015-10-02 11:00:19
clustering-algorithm degrees density edges graph graph-density hadoop mapreduce java


hadoop-job-time-prediction : Code used to perform some Hadoop job predictions experiments using OpenStack Sahara.
author: mari-linhares
created: 2015-10-16 14:53:13
hadoop hadoop-job prediction sahara python


devops-python-tools : DevOps CLI Tools for Hadoop, Spark, HBase, Log Anonymizer, Ambari Blueprints, AWS CloudFormation, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Elasticsearch, Solr, Travis CI, Pig, IPython - Python / Jython Tools
author: HariSekhon
created: 2015-10-27 15:06:56
ambari avro aws cloudformation docker dockerhub elasticsearch hadoop hbase hdfs json linux parquet pig pyspark python solr spark travis-ci xml


Big-Data-Training : Big data training homework
author: banadiga
created: 2015-11-03 19:28:42
hadoop hbase hdfs java redis shell


snappycat : A command line tool to decompress snappy files produced by Hadoop
author: shaform
created: 2015-11-05 14:17:21
compressed-data hadoop snappy c++


hadoop-deployment-bash : Code for the deployment of Hadoop clusters, written in Bourne or Bourne Again shell.
author: teamclairvoyant
created: 2015-11-11 15:29:23
bash cloudera hadoop hortonworks shell


forum-search : craw, store and index data for later search
author: at15
created: 2015-11-13 13:10:34
crawler hadoop java


star-join-spark : Two efficient algorithms to process Star Joins using the Spark framework: Spark Bloom-Filtered Cascade Join (SBFCJ) and the Spark Broadcast Join (SBJ)
author: jaquejbrito
created: 2015-11-18 22:04:32
databases hadoop mapreduce paper spark star-joins java


Gaffer : A large-scale entity and relation database supporting aggregation of properties
author: gchq
created: 2015-12-14 12:12:39
accumulo aggregation big-data graph graph-database hadoop hbase parquet spark java


HammerDataProject : Hammer Data Project
author: HammerProject
created: 2015-12-15 14:49:40
bigdata blindly-querying hadoop map-reduce opendata query-expansion query-language java


learning-spark : Tidy up Spark and Hadoop training tutorial
author: OSE-Lab
created: 2015-12-16 13:53:25
bigdata data-science hadoop spark java


hadoop-benchmark : Docker containers to build an Hadoop infrastructure and experiment feedback control loops atop of it.
author: Spirals-Team
created: 2015-12-18 15:51:24
docker evaluation hadoop shell


hadoop-unit :
author: jetoile
created: 2015-12-28 11:14:12
hadoop hadoop-unit java test


spark-training : Repository used for Spark Trainings
author: dimajix
created: 2015-12-28 15:08:55
hadoop hadoop-training hive pyspark python scala spark spark-ml spark-streaming spark-training sqoop jupyter notebook


Dockerfiles : DockerHub public images - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr / SolrCloud, Presto, Apache Drill, Nifi, Spark, Superset, H2O, Mesos, Serf, Consul, Riak, Alluxio, Jython, Advanced Nagios Plugins Collection / PyTools / Tools repos on CentOS / Ubuntu / Debian / Alpine
author: HariSekhon
created: 2016-01-17 01:14:03
apache-drill cassandra consul docker docker-image dockerhub hadoop hbase kafka kubernetes linux nagios-plugins nifi presto rabbitmq rabbitmq-cluster solr solrcloud spark zookeeper shell


hadoop-map-reduce-project : Hadoop map reduce program
author: VibhaBelavadi
created: 2016-01-22 18:48:56
big-data cloud-computing hadoop map-reduce java


eel-sdk : Big Data Toolkit for the JVM
author: 51zero
created: 2016-01-22 21:21:32
big-data etl hadoop hive kafka kudu orc parquet scala


telemetry-analysis-service : Telemetry Analysis Service
author: mozilla
created: 2016-02-08 10:13:40
analysis aws bigdata data django emr hadoop jupyter mozilla python spark telemetry


hive-funnel-udf : Hive UDFs for funnel analysis
author: yahoo
created: 2016-02-10 19:10:42
analytics funnel hadoop hive hive-udf udf java


distributedComputingExamples : Example codes for my Distributed Computing course at Hefei University.
author: thomasWeise
created: 2016-02-17 21:18:51
axis2 c communication distributed-computing glassfish hadoop html java java-rmi java-servlet javascript javaserver-pages json-rpc jsp mpi servlet-container socket web-services xml xml-document


bundle-realtime-syslog-analytics : Bundle for analyzing syslog data with Apache Spark and Apache Hadoop
author: juju-solutions
created: 2016-03-02 21:53:19
big-data bigdata charm cloud flume hadoop hdfs juju namenode opensource operations resourcemanager rsyslog spark zeppelin python


hadoopsetup : Hadoop Setup Files and Initialization Script for AWS node
author: viyatgandhi
created: 2016-03-05 03:36:46
hadoop shell-script shell


dockerfiles : Multi docker container images for main Big Data Tools. (Hadoop, Spark, Kafka, HBase, Cassandra, Zookeeper, Zeppelin, Drill, Flink, Hive, Hue, Mesos, ... )
author: jorgeacf
created: 2016-03-09 18:37:12
bigdata cassandra docker-image dockerfile drill flink hadoop hbase hive hue kafka mesos spark zeppelin zookeeper shell


baidu-cloud-plugin : Baidu Cloud Service Plugin
author: chenrui1988
created: 2016-03-14 01:23:59
baidu cloud gradle-plugin hadoop java


cdc-kafka-hadoop : MySQL to NoSQL real time dataflow
author: xmlking
created: 2016-03-19 21:19:22
architecture cdc change-data-capture data-flow debezium groovy hadoop kafka maxwell mysql nifi java


Cookies help us deliver our services. By using our services, you agree to our use of cookies Learn more