Exploratory Data Analysis using LLM and LangChain

In this tutorial, we will explore how to leverage LLM (Large Language Models) to do Exploratory Data Analysis (EDA), which is an important step in developing machine learning models.

We will use OpenAI as LLM and LangChain framework to orchestrate the prompts.

Video:

EDA steps to be explored using LLM:

• Getting meta data about the dataset
• Finding missing values
• Univariate Analysis like probability distribution, Histogram, box plot and outlier analysis
• Hypothesis test (t-test to compare distributions)
• Bivariate Analysis: Scatter plot, correlation analysis and heatmap

Notebook

---