Blog - {BigTechTalk}

October 24, 2024October 24, 2024Blog

How to install JupyterLab on Windows

JupyterLab is the latest web-based interactive development environment for notebooks, code, and data. Its flexible interface allows users to configure and arrange workflows in data science, scientific computing, computational journalism, […]

April 3, 2024April 4, 2024scala, Spark

How to Access Relational Data with Apache Spark

Apache Spark, a powerful Apache framework for large-scale data processing, seamlessly integrates with relational databases using JDBC (Java Database Connectivity). This enables you to leverage Spark’s distributed processing capabilities to […]

March 31, 2024March 31, 2024scala, Spark

How to find table size in Apache Spark

In this article, we will explore techniques for determining the size of tables without scanning the entire dataset using the Spark Catalog API. Understanding table sizes is critical for optimizing […]

March 22, 2024April 5, 2024python

How to Setup Conda Environment

When starting out, many new programmers are drawn to running their Python scripts directly through the default Python 2.x or 3.x interpreter. However, as your coding projects become increasingly intricate […]

November 26, 2023March 28, 2024Spark

How to Read CSV file using Spark DataFrame

In this post i will try to explain how to read a csv file using spark and scala. Spark provides spark.read().csv(“path”) and spark.read.format(“csv”).load(“path”) In this tutorial, you will learn how […]

August 1, 2023April 5, 2024java

How to use Log4J 2 Configuration: Using Properties File

1. What is log4j2 ? Apache Log4j2 is a logging framework for Java. It is a successor to Log4j, and it provides a number of improvements over its predecessor, including: […]

July 18, 2023April 5, 2024Spark

What is Session in Apache Spark

What is a Spark Session ? Spark Session was introduced in Spark 2.0 and it acts as an entry point into all functionality of Spark . Spark Session provides a […]

December 1, 2022March 19, 2024Spark

High Level Overview of Apache Spark

In this article, we are going to discuss the introductory part of Apache Spark, and the history of spark, and why spark is important. Let’s discuss one by one. According […]

November 27, 2022April 1, 2024Spark

How to Install Apache Spark on Windows 10

In this post, I’ll go through step-by-step instructions for installing Apache Spark on Windows 10 .If you already have Java 8 , you can skip the first steps. Install java […]

November 23, 2022March 19, 2024Spark

How to Install Spark on Ubuntu

In this article, we will cover the installation procedure of Apache Spark on the Ubuntu operating system. This article is divided into 4 parts. Install java on Ubuntu. Download the […]