Turn social media into LLM-ready data

Power your AI apps with clean data extracted from Reddit and TikTok.  
Built for research applications like IdeaApe, Perplexity, and deep market analysis.

Trusted By Research Teams

Currently powering IdeaApe's market intelligence platform.

Developer First

Enhance your research apps with industry-leading social media extraction.

Get research-ready data from social posts

Full threads, metadata, engagement metrics, Find relevant conversations with our revolutionary algorithm.

FAQs

What is PostCrawl?

PostCrawl is a high-performance social media data extraction service designed for AI and LLM applications. It provides structured, type-safe access to Reddit and TikTok content through simple API calls.

Which platforms does PostCrawl support?

Currently, PostCrawl supports Reddit and TikTok, with more platforms planned for the future.

How does PostCrawl pricing work?

PostCrawl uses a credit-based system where you purchase credits and each API operation consumes credits based on the operation type:

Search: ~1 credit per 10 results, ~2 credits per 100 results
Extract (without comments): ~1 credit per Reddit URL, ~2 credits per TikTok URL
Extract (with comments): ~4 credits per URL

What are the credit package options?

- 2,000 credits - $5 ($2.50 per 1,000 credits)  
- 20,000 credits - $50 ($2.50 per 1,000 credits)  
- 100,000 credits - $125 ($1.25 per 1,000 credits)  
- 250,000 credits - $250 ($1.00 per 1,000 credits)  
- 1,000,000 credits - $800 ($0.80 per 1,000 credits)  
- 5,000,000 credits - $3,250 ($0.65 per 1,000 credits)  
- Custom quantity available (2,000 - 10,000,000 credits)

Do credits expire?

Yes, credits expire after 6 months from purchase date.

Do new users get any free credits?

Yes, every new user receives 1,000 free credits for their first organization.

Can I add team members to my organization?

Yes, each organization can add unlimited users at no extra charge.

How do I upgrade my rate limit tier?

Tiers automatically upgrade based on your total spending:

- Tier 1 (Starter): $0 - $100 spending (1,000 credits/5min)
- Tier 2 (Growth): $100 - $1,000 spending (2,000 credits/5min)-
- Tier 3 (Scale): $1,000 - $10,000 spending (100,000 credits/5min)
- Tier 4 (Enterprise): $10,000+ spending (2,000,000 credits/5min)

New organizations start at tier 1. Tier upgrades take effect immediately on your next API request. For custom tier assignments, contact support.

What's the maximum number of results I can get per request?

- Search: Maximum 100 results per request  
- Extract: Maximum 100 URLs per request

What data formats are supported?

PostCrawl returns structured JSON data with full type definitions. For content extraction, you can also request markdown-formatted responses.

Can I search across multiple platforms at once?

Yes, you can search both Reddit and TikTok simultaneously by specifying both in the platform parameter.

Can I extract comments from posts?

Yes, both Reddit and TikTok posts support comment extraction.

Enable it with include_comments=True (costs ~4 credits per URL instead of ~1 for Reddit or ~2 for TikTok).

What information is included in search results?

Search results include title, URL, snippet, date posted, and image URL (when available).

What data is included when extracting a post?

- Reddit: Post ID, title, subreddit, URL, upvotes, downvotes, score, description, timestamps, and optionally comments.

- TikTok: Creator username, description, hashtags, likes, comment count, video URL, timestamps, and optionally comments.

What happens if I run out of credits?

The API will return an InsufficientCreditsError with details about credits required and credits available.

Which programming languages do you support?

We have type-safe SDKs for Python and Node .

However, PostCrawl supports every programming language through standard HTTP API requests. Any language that can make HTTP requests can integrate with our API.

Are there any example automations using PostCrawl?

Yes! Check out the n8n workflows repository for ready-to-use automations:

https://github.com/post-crawl/n8n-workflows

For example, there's a YouTube Script Generator workflow that demonstrates how to use PostCrawl in an automation pipeline.

Still have questions?