GitHub
This example goes over how to load data from a GitHub repository.
You can set the GITHUB_ACCESS_TOKEN
environment variable to a GitHub access token to increase the rate limit and access private repositories.
import { GithubRepoLoader } from "langchain/document_loaders/web/github";
const loader = new GithubRepoLoader(
"https://github.com/hwchase17/langchainjs",
{ branch: "main", recursive: false, unknown: "warn" }
);
const docs = await loader.load();