Timeline
86,800 memories — chronological, newest first.
Screen: Creatif
o
Code
Adminj
unclecode
Issues
A Transla
A Transla
github.com/unclecode/craw14ai
craw14ai
Transla
Transla
Discussions
Q
Transla
Actions
Go to file
A
Merline
Projects
Merline
Plugins
Merline +
2
Q Type LI to search
Ask Gemini
Star 65.6k
o
Work
x
28
Pull requests
Public
7 Branches
61
Agents
Tags
Security and quality 2
Watch 362
Sponsor
L Insights
craw14ai
main
unclecode
.claude
.context
.github
craw14
Fork 6.7k
About
Merge pull request #1885 from unclecode/develop
Add file
Idebe5f • 2 months ago
< > Code
O
1,468 Commits
2 months ago
2 months ago
2 months ago
2 months ago
2 months ago
2 months ago
last year
4 months ago
3 months ago
2 months ago
Craw14Al: Open-source LLM
Friendly Web Crawler & Scraper. Don't
be shy, join here:
https://discord.gg(jP8KfhDhyN
test: add comprehensive regr
May 15, 03:38 PM
[SUGGESTED_QUERY]
open source LLM web scraper
May 15, 03:38 PM
[SUGGESTED_QUERY]
unclecode crawl4ai features
May 15, 03:38 PM
Speaker 1: So, uh, Andrew's local AI scraper? Yeah, it's something we built for the AI overview in the local. I don't know if he posted that or not. I don't know if he's here.
Speaker 2: Yeah, I'm here. Hey, dude.
Speaker 1: There he is. Yeah, it should work. I haven't tried it in a second, but it's just...
May 15, 03:38 PM
[Chat Transcript]
Zoom Meeting
Participants:
Rich Fong
Chris Labbate
Michael Merlino
Chris Castillo
Bret Acott
Meeting controls:
- Recording and taking notes
- Richard's Fathom Notetaker
- AI Companion
Status: This meeting is being transcribed.
May 15, 03:38 PM
[SUGGESTED_QUERY]
Rich Fong Zoom meeting notes
May 15, 03:38 PM
[SUGGESTED_QUERY]
Meeting transcription with Michael Merlino
May 15, 03:38 PM
Person: Bret Acott
Role: ATTENDEE
May 15, 03:38 PM
Speaker 1: Uh, yeah. Yeah, did anybody try out, uh, Andrew's local AI scraper? He had something going for the AI overviews in local. I don't know if he posted that or not. I don't know if he's here.
Speaker 2: Yeah, I'm here.
Speaker 1: There he is.
Speaker 2: Yeah, I should...
May 15, 03:38 PM
Speaker 1: Yeah, how much is that not gonna be for scraping when you could just have that shit running on a fucking something you probably already got running? There's a lot of local free models, bro, that get busy. You know what I'm saying? Uh, real busy. Just throwing that in the air.
Speaker 2: Yeah, did anybody try...
May 15, 03:38 PM
...something scraped immediately and I'm doing it via Firecrawl and there's other ways but Firecrawl gets every motherfucking thing that I want possibly and my agent is trained on that, you know what I mean? Like, because if you're going to start paying, paying, if you think about it, at the end of the year...
May 15, 03:37 PM
We could try Hermes, yeah.
May 15, 03:37 PM
Speaker 1: Unless you're really going for speed, don't pay to scrape, bro. Get a fucking local model going that's way capable of doing that for free on a server or on something, you know?
Speaker 2: You could try Hermes, yeah.
Speaker 1: Uh, no, not try. I do not pay to scrape, bro, unless I want—
May 15, 03:37 PM
[Command-Line Output]
Claude Code v2.1.142
Opus 4.7 (1M context)
Working Directory: D:\ClaudeDev
UserPromptSubmtt says: view your session in honcho GUI:
[honcho] user-prompt injected conclusions (cached)
Skill (/install)
Successfully loaded skill
https://github.com/unclecode/crawl4ai
https://app.honcho.dev/explore?workspace=claude_code&view=sessions&session=mtke-claudedev
11 MCP servers need auth
/mcp
May 15, 03:37 PM
[SUGGESTED_QUERY]
Claude Code v2.1.142 development environment setup
May 15, 03:37 PM
[SUGGESTED_QUERY]
Configuring MCP servers for Claude Code
May 15, 03:37 PM
[SUGGESTED_QUERY]
Claude Code session management in Honcho
May 15, 03:37 PM
Website: https://merlino-brain-agentbrain-version-o0rzzbium-mmerlino23s-projects.vercel.app/
May 15, 03:37 PM
Screen: ORESTOCKO
MacHermes
bot
terminal: "set -euo pipefail URL='https://merlin...
May 14
todo: "updating 1 task(s)"
agentbrain.sh
AgentBrain — Enterprise agent runtime
The agent runtime that knows who can do what. Enterprise-grade RBAC,
audit, and on-prem deployment, powered by GoClaw.
11:07 PM
Got it — making a Mike/Merlino version of AgentBrain.sh
: same
vibe/structure, but original copy/branding for your ecosystem. I'll
build and deploy a Vercel preview.
11:07 PM
Unread Messages
I've got the reference: beige editorial SaaS landing page, black
text, massive type, numbered cards, compatibility grid, security/
method/FAQ/CTA. Building yours now.
11:07 PM
Deploy tripped on the reference screenshot binary. Skipping that
asset and redeploying the actual site.
11:09 PM
Vercel made it private by defa
May 15, 03:37 PM
Website: https://herc-agentbrain-mike.vercel.app/
May 15, 03:37 PM
Website: https://merlino-brain-agentbrain-version-00rzzbium-mmerlin023s-projects.vercel.app/
May 15, 03:37 PM
Website: https://merlin/
May 15, 03:37 PM
[SUGGESTED_QUERY]
Mike Merlino AgentBrain custom version
May 15, 03:37 PM
[SUGGESTED_QUERY]
Vercel project deployment automation
May 15, 03:37 PM
[SUGGESTED_QUERY]
AgentBrain landing page deployment
May 15, 03:37 PM
Website: https://merlino-brain-agentbrain-version-00rzzbium-mmerlin023s-projects.vercel.app
May 15, 03:37 PM
to scrape like that, it was about 15 bucks towards my max Claude AI subscription.
Uh, also OpenClaw, I think got back into the subscription. Yeah, go ahead.
May 15, 03:37 PM
[Chat Transcript]
Unigram
Recent Activity:
- Matteo: Your version is built as a standalone static site...
- Herc: I made your version of agentbrain...
- MacHermes: Done — your AgentBrain-style version is live: https://merlino-agentbrain-nxgk46pa9-mmerlin023s-projects.vercel.app
- Herman (Bot): Lead Engine 20260515T140854Z Scored: 69...
- Ava: my flights for Austin texas
- Oscar (Bot): make my version https://agentbrain.sh/
System Status:
- ClickUp snapshot: No overdue tasks.
- Fireflies: Could not verify May 14 action items.
- Cron: Creation blocked due to Gateway TransportError.
Priorities:
1. Reply to Oxylabs.
2. Decide on Google Cloud billing escalation.
3. Protect 11:30-3:00 calendar block.
Lead Engine Report (May 15, 2026):
- Campaign batch: 48
- Top leads include MasterTech Air, Tops Air Conditioning, and Blue Valley Electric.
SEO Keywords:
- Best SEO in Denver, How Much Does a Website Cost in Sarasota, Google Ads Management Sarasota, Video Marketing Sarasota, Is Local SEO Worth It in 2026, Ranking Reels, SEO in NYC.
May 15, 03:37 PM
Website: https://merlino-agentbrain-nxgk46pa9-mmerlin023s-projects.vercel.app/
May 15, 03:37 PM
[SUGGESTED_QUERY]
Lead generation report May 2026
May 15, 03:37 PM
[SUGGESTED_QUERY]
SEO keyword research for local business
May 15, 03:37 PM
[SUGGESTED_QUERY]
AgentBrain static site deployment status
May 15, 03:37 PM
Website: http://airconditioninginstallationsvs.com
May 15, 03:37 PM
Website: http://electricalworksofhouston.com
May 15, 03:37 PM
Website: http://calliduselectric.com
May 15, 03:37 PM
Website: http://electricdaves.com
May 15, 03:37 PM
Website: http://petri-electric.com
May 15, 03:37 PM
Website: http://bluevalleyelectrical.com
May 15, 03:37 PM
Website: http://topsheatingacsvs.com
May 15, 03:37 PM
Website: http://masterstechair.com
May 15, 03:37 PM
Website: http://gmb.brandnorth.com
May 15, 03:37 PM
Website: https://merlino-agentbrain-nxgk46pa9-mmerlin023s-projects.vercel.app
May 15, 03:37 PM
Speaker 1: When you do a scrape like that, it was about 15 bucks towards my max Claude AI subscription. Uh, also OpenClaw [?], I think, got, uh, back...
Speaker 2: Sorry Chris, real quick. Unless you're going for speed, my brother, like...
May 15, 03:37 PM
[Command-Line Output]
North Valley
Claude Code v2.1.142
Opus 4.7 (1M context)
Path: D:\ClaudeDev
URL: https://github.com/unclecode/craw14a
Commands:
- permissions (shift+tab)
- install (shift+tab)
- Press up to edit queued messages
Skedaddling...
May 15, 03:37 PM
[SUGGESTED_QUERY]
Claude Code command line permissions install
May 15, 03:37 PM
[SUGGESTED_QUERY]
github.com/unclecode/craw14a repository
May 15, 03:37 PM
Website: https://github.com/unclecode/craw14a
May 15, 03:37 PM
Speaker 1: Is it able to scrape emails and like the actual...
Speaker 2: Exactly. Find the LinkedIn, all their email, telephone, website, you know, contact data. Pretty flawless from start to finish. So, wasn't too bad. It was about...
May 15, 03:36 PM
Speaker 1: ...actual—
Speaker 2: Yeah, exactly. Find the info. So LinkedIn, all their email, telephone, website, you know, contact data. Uh, pretty flawless from start to finish. So, uh, wasn't too bad. It was about... when you...
May 15, 03:36 PM
[Command-Line Output]
North Valley
The pattern that's working:
- Any visitor typing the original site URL globally bounced to /locations/ to pick a city.
- Any visitor inside a silo using the original NVSP URL convention 308'd to the canonical city silo URL.
- All 9 city pages x 15 cities = 135 actual content pages, all live.
So every URL Mike's prospects/old GBP links/Google index might point to is now a clean 200 (after at most one redirect hop) on the new site.
[honcho] response: saved response (1665 chars)
Stop says: Baked for 56s. No, those would need to be on every silo individually. Imagine taking one location website, cloning it onto a subdomain and then doing that per location, but I don't want 15 different domains. I want the silo to be a website completely on its own. Create 15 pages for each of the URLs I am dropping.
[honcho] user-prompt injected conclusions
UserPromptSubmit says: You're right. 3 of those URLs are currently redirects instead of dedicated pages, and they need to be standalone pages on each of the 15 silos. That's 45 missing pages.
The gap:
- 3 URLs currently redirecting need their own pages x 15 = 45 pages.
- Plus, the original NVSP canonical URL structure should be the source of truth. So I'm flipping the redirects: shortcut URLs will redirect to the original-NVSP-style canonical URLs.
Agent (Build 45 missing silo pages + flip canonicals)
Done (60 tool uses, 197.7k tokens, 17m 1s)
595 routes live on https://nvsp-rebuild.vercel.app. All 45 new pages built (3 types x 15 cities). The 9 URLs you listed are now all dedicated pages per city. URL structure now mirrors the original NVSP inside every silo.
May 15, 03:36 PM