Notion DB 2/2
Notion is a collaboration platform with modified Markdown support that integrates kanban boards, tasks, wikis and databases. It is an all-in-one workspace for notetaking, knowledge and data management, and project and task management.
NotionDBLoader
is a Python class for loading content from a Notion
database. It retrieves pages from the database, reads their content, and returns a list of Document objects. NotionDirectoryLoader
is used for loading data from a Notion database dump.
Requirements
- A
Notion
Database - Notion Integration Token
Setup
1. Create a Notion Table Database
Create a new table database in Notion. You can add any column to the database and they will be treated as metadata. For example you can add the following columns:
- Title: set Title as the default property.
- Categories: A Multi-select property to store categories associated with the page.
- Keywords: A Multi-select property to store keywords associated with the page.
Add your content to the body of each page in the database. The NotionDBLoader will extract the content and metadata from these pages.
2. Create a Notion Integration
To create a Notion Integration, follow these steps:
- Visit the Notion Developers page and log in with your Notion account.
- Click on the "+ New integration" button.
- Give your integration a name and choose the workspace where your database is located.
- Select the require capabilities, this extension only need the Read content capability
- Click the "Submit" button to create the integration.
Once the integration is created, you'll be provided with an
Integration Token (API key)
. Copy this token and keep it safe, as you'll need it to use the NotionDBLoader.
3. Connect the Integration to the Database
To connect your integration to the database, follow these steps:
- Open your database in Notion.
- Click on the three-dot menu icon in the top right corner of the database view.
- Click on the "+ New integration" button.
- Find your integration, you may need to start typing its name in the search box.
- Click on the "Connect" button to connect the integration to the database.
4. Get the Database ID
To get the database ID, follow these steps:
- Open your database in Notion.
- Click on the three-dot menu icon in the top right corner of the database view.
- Select "Copy link" from the menu to copy the database URL to your clipboard.
- The database ID is the long string of alphanumeric characters found in the URL. It typically looks like this: https://www.notion.so/username/8935f9d140a04f95a872520c4f123456?v=.... In this example, the database ID is 8935f9d140a04f95a872520c4f123456.
With the database properly set up and the integration token and database ID in hand, you can now use the NotionDBLoader code to load content and metadata from your Notion database.
5. Installation
Instaall the langchain-community
integration package.
%pip install -qU langchain-community
Notion Database Loader
NotionDBLoader is part of the langchain package's document loaders. You can use it as follows:
from getpass import getpass
NOTION_TOKEN = getpass()
DATABASE_ID = getpass()
········
········
from langchain_community.document_loaders import NotionDBLoader
loader = NotionDBLoader(
integration_token=NOTION_TOKEN,
database_id=DATABASE_ID,
request_timeout_sec=30, # optional, defaults to 10
)
docs = loader.load()
print(docs)
Notion Directory Loader
Setup
Export your dataset from Notion. You can do this by clicking on the three dots in the upper right hand corner and then clicking Export
.
When exporting, make sure to select the Markdown & CSV
format option.
This will produce a .zip
file in your Downloads folder. Move the .zip
file into this repository.
Run the following command to unzip the zip file (replace the Export...
with your own file name as needed).
unzip Export-d3adfe0f-3131-4bf3-8987-a52017fc1bae.zip -d Notion_DB
Usage
Run the following command to ingest the data you just downloaded.
from langchain_community.document_loaders import NotionDirectoryLoader
loader = NotionDirectoryLoader("Notion_DB")
docs = loader.load()
Related
- Document loader conceptual guide
- Document loader how-to guides