Gatsby Limit?

[ahansson89]

I wonder what the limit for Gatsby is? I know I can make sites with 10,000 pages. But what if I have sites that have 1,000.000+ pages? Will Gatsby be able to handle that?

What limits have you guys hit with v2?

[luukdv]

Related: #9362

[kakadiadarpan]

@ahansson89 The aim for Gatsby is to work for million page sites, but it’s not there yet. We have been working to make Gatsby great for larger scale sites. For that, we have been focusing on improving the performance and build times for large sites. Following are the PRs which have made a lot of difference:

#6226
#9370
#9338 (this is WIP, also focussed on larger site performance)

You can also take a look at the benchmark sites for testing bigger sites https://github.com/gatsbyjs/gatsby/tree/master/benchmarks

[pieh]

Page count limit is really fluid - it depends on how content heavy your site is and what is being used for your site. We have some benchmarks https://github.com/gatsbyjs/gatsby/tree/master/benchmarks/create-pages and https://github.com/gatsbyjs/gatsby/tree/master/benchmarks/markdown that stress test different parts of gatsby - but results of those benchmark won't be the same as for real production sites.

As @kakadiadarpan mentioned - there is continuous progress on optimizing bottlenecks that limit size of websites

[ahansson89]

Page count limit is really fluid - it depends on how content heavy your site is and what is being used for your site. We have some benchmarks https://github.com/gatsbyjs/gatsby/tree/master/benchmarks/create-pages and https://github.com/gatsbyjs/gatsby/tree/master/benchmarks/markdown that stress test different parts of gatsby - but results of those benchmark won't be the same as for real production sites.

As @kakadiadarpan mentioned - there is continuous progress on optimizing bottlenecks that limit size of websites

Of course. Let's say it's a news/blog type of sites with blog posts 800 words on average, just to define a standard for the discussion.

Will I be able to deploy a 1,000,000+ pages site with Gatsby as of right now? If not, where are the bottlenecks?

[gatsbot]

Old issues will be closed after 30 days of inactivity. This issue has been quiet for 20 days and is being marked as stale. Reply here or add the label "not stale" to keep this issue open!

[gatsbot]

Hey again!

It’s been 30 days since anything happened on this issue, so our friendly neighborhood robot (that’s me!) is going to close it.

Please keep in mind that I’m only a robot, so if I’ve closed this issue in error, I’m HUMAN_EMOTION_SORRY. Please feel free to reopen this issue or create a new one if you need anything else.

Thanks again for being part of the Gatsby community!