Large sitemaps time out on Vercel free tier

[dbredvick]

Summary: Because my Notion document is growing somewhat large, the sitemap request times out under Vercel's free tier (10 seconds).

Notion page: https://www.notion.so/dbredvick/Drew-tech-1e0b275c5ca44b4bbf5dc0e24017f593

I'll be looking into fixing this on my blog, will contribute upstream when I have a reasonable fix.

[dbredvick]

As an initial fix, bumping the concurrency from concurrency: 4 to concurrency: 5 was sufficient for my blog in get-site-maps.ts.

[transitive-bullshit]

Thanks @dbredvick; WIP solution tracking here #83

[Mvbbb]

I have the same issue, but "bumping the concurrency from concurrency: 4 to concurrency: 5" don't work for me.
Then I tried to access sitemap.xml locally,but I got 404.

[dbredvick]

I ultimately decided to start paying Vercel $20 a month to switch timeouts to 60 seconds. Well worth it for me as I host all my projects on Vercel.

[transitive-bullshit]

@Mvbbb can you comment on this issue with a link to your site.config.js so I can repro more easily?

@dbredvick nice — that's definitely one solution 😄

#83 should provide a very solid speedup, but I don't have the time at the moment to push it over the finish line.

[dbredvick]

@transitive-bullshit I might be able to take a look at #83 over the weekend.

[Mvbbb]

@transitive-bullshit Sure。
https://github.com/Mvbbb/nextjs-notion-blog/blob/master/site.config.js

[transitive-bullshit]

I believe this should be fixed with the recent addition of optional redis caching for pathname to notion page ID lookups.

[octrow]

Unfortunately sitemap.xml generation outputs a 504 error.
I read that this is due to a 10 second limit on the free plan from vercel, but has been resolved with the redis labs update.
I have caching connected via redis labs (free plan), I checked the operation via monitor in redis-cli as I thought I might have a connection problem, but I can see the image caching working.

I've been reading the @keyvhq/redis documentation and googling solutions and similar errors, but unfortunately haven't been able to find any solutions in the last 5 days.

Perhaps the problem is related to the fact that many pages have manually (via table in notion) changed Slug.

Error page: https://www.boklanov.ru/sitemap.xml