How I Took Karpathy's LLM Wiki and Built an AI-Powered Second Brain in Obsidian
Claude Code as the engine, Obsidian Skills as the glue, and a downloadable starter kit so you can set it up this afternoon.
Iāve saved hundreds of articles, podcasts, and YouTube videos across Notion, Pocket, and browser bookmarks over the years. And every time I wanted to revisit something Iād read, I had to dig through all of it just to find it. Even when I did, that article sat in complete isolation from everything else Iād saved on the same topic.
When I moved everything into Obsidian (I wrote about this in my project management post), it solved the tool fragmentation. One vault, all markdown, all accessible to Claude Code. But my notes still didnāt talk to each other. An article about automation had no connection to a podcast about AI coding workflows, which had no connection to an essay about why writing forces you to think clearly.
I was the one responsible for drawing those lines. Because it took so much effort, I didnāt actually do it as often as I expected. Thatās the honest truth about noteātaking systems like Zettelkasten and ābuilding a second brain.ā The theory is beautiful; in practice, the maintenance kills it.
Then I saw what Andrej Karpathy shared. You know how much he inspires meāthis is the second workflow Iāve copied from him.
For anyone who doesnāt know him, Karpathy is one of the most respected AI researchers in the world.
He described a pattern he called an āLLM Wiki.ā The idea is simple but the shift is significant: instead of you maintaining a knowledge base and occasionally asking AI questions about it, the LLM builds and maintains the entire knowledge base for you.
You collect raw sources. Articles, papers, book notes, podcast takeaways, anything. You drop them into a folder. Then you tell the LLM to ācompileā them into a wiki. It reads every source, writes summary pages, creates pages for key people and concepts, and cross-references everything. A single article might touch 10-15 pages across your wiki. The LLM handles all the bookkeeping youād never do yourself.
Karpathy put it this way:
āObsidian is the IDE, the LLM is the programmer, the wiki is the codebase.ā
You rarely ever write or edit the wiki manually. Thatās the domain of the LLM.
And the part that hit me hardest: this compounds. Every new source the LLM ingests makes the whole wiki smarter. It becomes a network that grows denser over time. An article about Tim Dettmersā automation framework gets connected to Addy Osmaniās AI coding workflow, which gets connected to Dan Koeās essay on why writing is thinking. Three completely different topics, three different authors, one thread running through all of them that I never would have drawn on my own.
Hereās the build: Obsidian as the interface, Claude Code as the agent, and a set of Obsidian Skills that Steph Ango (the CEO of Obsidian) released to teach Claude how to write in Obsidianās native language. Wikilinks. Callouts. Canvas. A CLI (Command Line Interface) for running the whole thing from the terminal. If youāre an Obsidian nerd, that last piece is what makes this actually work.
Iāve been running this system for my own interests. AI, human psychology, personal productivity, health and fitness, building a business. All of it flowing into one knowledge base where everything connects to everything else.
šØ Heads up: AI Maker Lab pricing goes up tonight, from $10/month to $15. If you enjoyed this post and want the full library of 25+ paid blueprints, plus everything coming next (video walkthroughs, expert conversations, monthly Q&A), today is the last day to lock in the current rate.
Whatās Inside This Post
This post is the complete blueprint for building the system I just described. Not the theory. The exact folder structure, the commands, the schema, and a starter kit you can download and set up this afternoon.
Hereās what youāll walk away with:
The Three-Layer Architecture: How the knowledge base is organized: raw sources (your immutable reading material), the wiki (LLM-generated summary pages, cross-references, and concept maps), and the schema (the CLAUDE.md file that turns Claude from a generic chatbot into a disciplined wiki maintainer). Iāll show you how data flows between layers and why this structure makes the whole system work.
The Three Operations That Run the System: The exact slash commands I use daily:
/ingest-url(feed it a URL, Claude extracts the article and compiles it into the wiki, touching 5-15 pages in a single pass),/process-inbox(fleeting thoughts and quick notes get classified and integrated automatically), and/lint-wiki(a health check that finds broken links, orphan pages, contradictions, and content gaps the wiki suggests you research next).Obsidian Skills (The Missing Piece): A set of agent skills that teach Claude how to work fluently with Obsidianās native features. Wikilinks, callouts, frontmatter, the Obsidian CLI, database views with Bases, and visual canvases. These are what turn Obsidian from āa folder of markdown filesā into a proper knowledge management platform that an LLM can operate natively.
Real Examples of the System in Action: I made a video to walk you through this whole process so you can apply it on your own.
The Complete Starter Kit + Setup Guide: A downloadable starter kit with the entire system pre-built: folder structure, three slash commands, all five Obsidian Skills, the schema, templates for books and podcasts, and a step-by-step guide to customize it for your own interests. One afternoon to set up. After that, the system runs on three commands.
By the end of this post, youāll have a personal knowledge base where every article, book, podcast, and fleeting thought feeds into a living wiki that gets smarter the more you use it. Ask it a question six months from now and it gives you an answer synthesized from everything youāve ever fed it.
To give you a clue, this is what it looks like when Claude ingests the "Paul Grahamās āHow to Think for Yourselfā and turns it into a wiki page:
The wiki page looks visually appealing, with proper wikilinks, frontmatter, tagging, and callouts, because it leverages Obsidian skills, so Claude knows which features to use in Obsidian. The most interesting part is the Notes section, where Claude creates a connection to Dan Koeās writing essay. The bigger you build your wiki pages, the more connections youāll find that you didnāt even notice, thatās how powerful this knowledge base is.
Before we go further: This system runs on Claude Code. If youāre not familiar with it, Iād recommend reading my beginnerās guide first for the basics, or my ultimate guide for the full picture, or my project setup tutorial to get started. You donāt need to be a developer, but you do need to be comfortable with a terminal. Alternatively, you can use the Claude Code extension inside VS Code or Cursor.
Letās build it.
The Three-Layer Architecture of AI-powered Second Brain
The system has three layers. Thatās it. Once you understand how they relate to each other, everything else in this post will make sense.
sources/ ā
āā Layer 1: Input (everything that feeds the system)
inbox/ ā
wiki/ ā Layer 2: LLM-generated knowledge pages (summaries, cross-references, concepts)
CLAUDE.md ā Layer 3: The schema that governs how the wiki operatesLayer 1: Input (The Raw Material)
The sources/ folder is where your reading goes. Articles, book notes, podcast takeaways, PDFs, anything you want to remember. Organized by whatever categories make sense for your interests.
Mine looks like this:
sources/
ai/
health-and-fitness/
human-psychology/
personal-productivity/
books/
podcasts/One rule: files in sources/ are immutable. Once you save something here, you donāt edit it. This is your source of truth. The raw material that everything else gets built from.
There are two ways to get content in:
1. Obsidian Web Clipper (browser extension)
See an article you want to save? One click and it becomes a markdown file in your vault. You choose where it goes. This is the manual path, good when youāre browsing and want control over what gets captured.
And it doesnāt stop at articles. You can also send an entire YouTube podcast, along with its transcript, into Obsidian. Simply open the extension on the YouTube link you want to save to your Obsidian vault or click āReaderā view to see the full transcript details.







