Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Filter by Categories
About Article
Analyze Data
Archive
Best Practices
Better Outputs
Blog
Code Optimization
Code Quality
Command Line
Daily tips
Dashboard
Data Analysis & Manipulation
Data Engineer
Data Visualization
DataFrame
Delta Lake
DevOps
DuckDB
Environment Management
Feature Engineer
Git
Jupyter Notebook
LLM
LLM
Machine Learning
Machine Learning
Machine Learning & AI
Manage Data
MLOps
Natural Language Processing
NumPy
Pandas
Polars
PySpark
Python Tips
Python Utilities
Python Utilities
Scrape Data
SQL
Testing
Time Series
Tools
Visualization
Visualization & Reporting
Workflow & Automation
Workflow Automation

Jupyter Notebook

Generate requirements.txt File for Jupyter Notebooks Based on Imports

pip freeze saves all packages in the environment, including ones that you don’t use in your current project. To generate a requirements.txt based on imports in your Jupyter Notebooks, use pipreqsnb. For example, to save all packages in your current project to a requirements.txt file, run: <meta http-equiv="content-type" content="text/html; charset=utf-8">$ pipreqsnb . Link to pipreqsnb.To generate requirements.txt for Python scripts, use pipreqs instead.For a deeper dive into managing and tracking changes in notebooks, check out one of my articles on Jupyter Notebook. These 3 essential tools for version-controlling Jupyter notebooks.Favorite

Generate requirements.txt File for Jupyter Notebooks Based on Imports Read More »

Introduction to Deepnote: Real-time Collaboration on Jupyter Notebook

Have you ever wanted to collaborate with your teammates on a project using Jupyter Notebook? Google Colab allows you and others to edit and comment on the same project, but you cannot see their changes in real-time.
Wouldn’t it be nice if you can see the real-time changes as shown in the GIF above? That is when Deepnote comes in handy.
Some other cool features of Deepnote are:

Automatically building dependencies for your notebook
Integrating with other platforms
Sharing your dataset with ease
Building a report for your notebook

In my latest article, I will go through how each of these features can increase your experience using a notebook.
Link to the article.
Link to Deepnote.Favorite

Introduction to Deepnote: Real-time Collaboration on Jupyter Notebook Read More »

watermark: Get Information About Your Hardware and the Packages Being Used within Your Notebook

If you want to get information about your hardware and the Python packages being used within your notebook, use the magic extension watermark.
The image above shows the outputs of the watermark in my notebook.
Link to watermark.
Link to the source code.Favorite

watermark: Get Information About Your Hardware and the Packages Being Used within Your Notebook Read More »

ngrok: Create a Public Server for your Jupyter Notebook in 1 Line of Code

Have you ever wanted to quickly share your local Jupyter Notebook with your teammates or friends? That is when ngrok comes in handy.
ngrok allows you to create a public server for your notebook that can be shared to another machine. All it takes is the initial setup and one command line.
Find more about ngrok in my article.
Link to the source code.Favorite

ngrok: Create a Public Server for your Jupyter Notebook in 1 Line of Code Read More »

Scroll to Top

Work with Khuyen Tran

Work with Khuyen Tran