Hey guys, In this article, I will briefly discuss what is Apache Pig and explain how to install Apache Pig in on a Hadoop cluster. I will provide step-by-step installation instructions to set up Pig on Ubuntu 16.04. So, if you have the curiosity to know about Pig and its…

Hey guys, In this article, I will explain how to install Apache HBase in standalone mode on a Hadoop cluster. I will provide step by step instructions to set up HBase on Ubuntu 16.04. So, if you are looking to make your hands dirty on Apache HBase, this article can…

(Which is the best fit for you?) Hey guys, In this article I am going to discuss Apache Spark vs Apache Hadoop and when to choose what? Big data analysis has become the secret to success in many businesses. Businesses are constantly attempting to get more insights from every piece…

Hey guys, In Machine Leaning (ML) based predictive modelling bias and variance plays vital roles. High bias model leads to under fitting whereas high variance starts to over fit of the model. However, ideally a ML model should achieve low bias and low variance which is impossible task. So, a…

Hey guys, High dimensionality throws challenges in performance accuracy of machine learning models. In this article, I explored the importance of dimensionality reduction in building machine learning models and discussed why high dimensionality impacts the performance of machine learning models / statistical models. Here, I touched upon the following questions: …

Exploring partitioning vs clustering in the Hive table, and understanding when to do partitioning and when to do clustering — Hey guys, Apache Hive is one of the popular data warehouses in distributed cluster environments. Apache hive is used to store massive amounts of data and it can be processed in a fast, parallel, and efficient manner in HDFS (Hadoop Distributed File System) environment. To improve the access time of…

Explaining managed tables vs. external tables in Apache Hive. — Hello everyone, In this article I am going to explain managed tables vs. external tables in Apache Hive. This question is prominently featured in the interviews. So, if you want clarity on this aspect, this article is for you. So, lets dive into deep in the discussion. Apache Hive is…

Hey guys, In this article I am going present Create, Read, Update, and Delete (CURD) operation with examples which you can perform in MongoDB. Mongo DB is a document based NOSQL database which is quite popular in the industry. …

Hey guys, In this article, I will explain how to set up Apache Spark 3.1.1 on a multi-node cluster which includes installing spark master and workers. I will provide step-by-step instructions to set up spark on Ubuntu 16.04. …