fix: helia-docker container dies when running in tiros

[SgtPooki]

We need to move away from using an in-memory data-store because there is no way to limit the amount of memory used. @wemeetagain mentioned that Lodestar uses an in-mem datastore that flushes to file-system. The code for that is https://github.com/ChainSafe/lodestar/blob/unstable/packages/beacon-node/src/network/peers/datastore.ts#L71

If lodestar has a datastore we can use, we should use that, otherwise we should migrate to use file-system directly and then update to use lodestar strategy.

from #18 (comment)

---

log-events-viewer-result.csv

### Action items before close
- [x] ensure the helia-http-gateway version deployed on Tiros is the latest version
- [x] Use file-based datastore
- [ ] Use mem->file flushing datastore & blockstore
- [x] Investigate potentially hanging promises for helia-all & helia-delegated-routing? tiros jobs not finishing: https://github.com/plprobelab/probelab-infra/issues/87

[SgtPooki]

After some research last week, it looks like helia is adding too many eventListeners to user provided signals, and recalling any-signal multiple times with the same signal in https://github.com/libp2p/js-libp2p/blob/master/packages/libp2p/src/connection-manager/dial-queue.ts

And overall just mis-managing the AbortSignal's used (shutdown controller, timeout signal per dial, user shutdown controller, combineSignal that adds more event Listeners) and this is causing the docker container to fall over.

js-libp2p (in node) currently sets max eventlisteners to Infinity as a workaround for this.. but.. I don't imagine that's a great way to handle things and need to investigate this further.

[SgtPooki]

Error from my container running for 12 hours locally:

2023-10-22 21:50:33 Server listening on http://0.0.0.0:8080
2023-10-22 23:03:55 (node:26) MaxListenersExceededWarning: Possible EventTarget memory leak detected. 11 relay:removed listeners added to ReservationStore. Use events.setMaxListeners() to increase limit
2023-10-22 23:03:55     at [kNewListener] (node:internal/event_target:553:17)
2023-10-22 23:03:55     at ReservationStore.addEventListener (node:internal/event_target:666:23)
2023-10-22 23:03:55     at ReservationStore.addEventListener (file:///app/node_modules/@libp2p/interface/dist/src/events.js:19:15)
2023-10-22 23:03:55     at new CircuitRelayTransportListener (file:///app/node_modules/libp2p/dist/src/circuit-relay/transport/listener.js:18:25)
2023-10-22 23:03:55     at createListener (file:///app/node_modules/libp2p/dist/src/circuit-relay/transport/listener.js:75:12)
2023-10-22 23:03:55     at CircuitRelayTransport.createListener (file:///app/node_modules/libp2p/dist/src/circuit-relay/transport/index.js:192:16)
2023-10-22 23:03:55     at DefaultTransportManager.listen (file:///app/node_modules/libp2p/dist/src/transport-manager.js:147:44)
2023-10-22 23:03:55     at reserveQueue.add.peerId.peerId (file:///app/node_modules/libp2p/dist/src/circuit-relay/transport/reservation-store.js:144:45)
2023-10-22 23:03:55     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
2023-10-22 23:03:55     at async file:///app/node_modules/p-queue/dist/index.js:118:36

[SgtPooki]

starting up helia-http-gateway outside of docker and requesting /ipns/blog.libp2p.io:

╰─ ✔ ❯ PORT=8888 DEBUG="helia-server*" npm run start:dev                                                                                               9.35   21.4G   46%   100%  ─╯

> helia-docker@0.0.1 start:dev
> npm run build && node --trace-warnings dist/src/index.js


> helia-docker@0.0.1 build
> aegir build --bundle false

[09:39:17] tsc [started]
[09:39:18] tsc [completed]
process.env.DEBUG:  helia-server*
  helia-server:express:helia-fetch Initializing helia-fetch... +0ms
  helia-server:express:helia-fetch Initialized +723ms
Helia Started!
  helia-server:express Initialized +0ms
Server listening on http://0.0.0.0:8888
  helia-server:express:helia-fetch Parsing path: /ipns/assets/css/0.styles.4520169f.css +14s
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'assets',
  relativePath: '/css/0.styles.4520169f.css'
} +0ms
  helia-server:express Referer found: http://localhost:8888/ipns/blog.libp2p.io +14s
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io +1ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: ''
} +0ms
  helia-server:express Redirecting to final URL: http://localhost:8888/ipns/blog.libp2p.io/assets/css/0.styles.4520169f.css +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/site.webmanifest +3ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'site.webmanifest',
  relativePath: ''
} +0ms
  helia-server:express Referer found: http://localhost:8888/ipns/blog.libp2p.io +3ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: ''
} +0ms
  helia-server:express Redirecting to final URL: http://localhost:8888/ipns/blog.libp2p.io/site.webmanifest +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/assets/css/0.styles.4520169f.css +19s
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'assets',
  relativePath: '/css/0.styles.4520169f.css'
} +0ms
  helia-server:express Referer found: http://localhost:8888/ipns/blog.libp2p.io +19s
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io +1ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: ''
} +0ms
  helia-server:express Redirecting to final URL: http://localhost:8888/ipns/blog.libp2p.io/assets/css/0.styles.4520169f.css +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/assets/js/app.429d2de8.js +2ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'assets',
  relativePath: '/js/app.429d2de8.js'
} +0ms
  helia-server:express Referer found: http://localhost:8888/ipns/blog.libp2p.io +2ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: ''
} +0ms
  helia-server:express Redirecting to final URL: http://localhost:8888/ipns/blog.libp2p.io/assets/js/app.429d2de8.js +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/assets/js/3.2eedf0e2.js +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'assets',
  relativePath: '/js/3.2eedf0e2.js'
} +0ms
  helia-server:express Referer found: http://localhost:8888/ipns/blog.libp2p.io +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: ''
} +0ms
  helia-server:express Redirecting to final URL: http://localhost:8888/ipns/blog.libp2p.io/assets/js/3.2eedf0e2.js +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/js/app.429d2de8.js +122ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/js/app.429d2de8.js'
} +0ms
  helia-server:express Referer found: http://localhost:8888/ipns/blog.libp2p.io +122ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: ''
} +0ms
  helia-server:express Requesting content from helia: /ipns/blog.libp2p.io/assets/js/app.429d2de8.js +0ms
  helia-server:express Fetching from Helia: /ipns/blog.libp2p.io/assets/js/app.429d2de8.js +0ms
  helia-server:express:helia-fetch Fetching: /ipns/blog.libp2p.io/assets/js/app.429d2de8.js +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/js/app.429d2de8.js +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/js/app.429d2de8.js'
} +0ms
  helia-server:express:helia-fetch Processing Fetch: {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/js/app.429d2de8.js'
} +0ms
  helia-server:express:helia-fetch Fetching from Delegate Routing: blog.libp2p.io +1ms
  helia-server:express:helia-fetch Final IPFS path: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/js/app.429d2de8.js +815ms
  helia-server:express:helia-fetch Fetching: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/js/app.429d2de8.js +0ms
  helia-server:express:helia-fetch Parsing path: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/js/app.429d2de8.js +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipfs',
  address: 'QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN',
  relativePath: '/assets/js/app.429d2de8.js'
} +0ms
  helia-server:express:helia-fetch Processing Fetch: {
  namespace: 'ipfs',
  address: 'QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN',
  relativePath: '/assets/js/app.429d2de8.js'
} +0ms
(node:92038) MaxListenersExceededWarning: Possible EventTarget memory leak detected. 11 abort listeners added to [AbortSignal]. Use events.setMaxListeners() to increase limit
    at [kNewListener] (node:internal/event_target:527:17)
    at [kNewListener] (node:internal/abort_controller:239:24)
    at EventTarget.addEventListener (node:internal/event_target:638:23)
    at anySignal (file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/any-signal/dist/src/index.js:21:20)
    at IpniContentRouting.findProviders (file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/@libp2p/ipni-content-routing/dist/src/index.js:51:24)
    at findProviders.next (<anonymous>)
    at file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/it-merge/dist/src/index.js:27:38
    at Array.map (<anonymous>)
    at file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/it-merge/dist/src/index.js:26:43
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
  helia-server:express:helia-fetch Fetching from IPFS: {
  cid: CID(QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN),
  type: 'file',
  options: { path: '/assets/js/app.429d2de8.js' }
} +7s
  helia-server:express:helia-fetch Getting file response: {
  cid: CID(QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN),
  options: { path: '/assets/js/app.429d2de8.js' }
} +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/js/app.429d2de8.js +2s
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/js/app.429d2de8.js'
} +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/favicon-16x16.png +496ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'favicon-16x16.png',
  relativePath: ''
} +0ms
  helia-server:express Referer found: http://localhost:8888/ipns/blog.libp2p.io +10s
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: ''
} +0ms
  helia-server:express Redirecting to final URL: http://localhost:8888/ipns/blog.libp2p.io/favicon-16x16.png +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/img/go-2022.b6c02c94.png +58ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/go-2022.b6c02c94.png'
} +0ms
  helia-server:express Referer found: http://localhost:8888/ipns/blog.libp2p.io +58ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: ''
} +0ms
  helia-server:express Requesting content from helia: /ipns/blog.libp2p.io/assets/img/go-2022.b6c02c94.png +0ms
  helia-server:express Fetching from Helia: /ipns/blog.libp2p.io/assets/img/go-2022.b6c02c94.png +0ms
  helia-server:express:helia-fetch Fetching: /ipns/blog.libp2p.io/assets/img/go-2022.b6c02c94.png +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/img/go-2022.b6c02c94.png +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/go-2022.b6c02c94.png'
} +0ms
  helia-server:express:helia-fetch Processing Fetch: {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/go-2022.b6c02c94.png'
} +0ms
  helia-server:express:helia-fetch Final IPFS path: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/go-2022.b6c02c94.png +1ms
  helia-server:express:helia-fetch Fetching: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/go-2022.b6c02c94.png +0ms
  helia-server:express:helia-fetch Parsing path: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/go-2022.b6c02c94.png +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipfs',
  address: 'QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN',
  relativePath: '/assets/img/go-2022.b6c02c94.png'
} +0ms
  helia-server:express:helia-fetch Processing Fetch: {
  namespace: 'ipfs',
  address: 'QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN',
  relativePath: '/assets/img/go-2022.b6c02c94.png'
} +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/img/libp2p_http.d5e34487.png +805ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/libp2p_http.d5e34487.png'
} +0ms
  helia-server:express Referer found: http://localhost:8888/ipns/blog.libp2p.io +806ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: ''
} +0ms
  helia-server:express Requesting content from helia: /ipns/blog.libp2p.io/assets/img/libp2p_http.d5e34487.png +0ms
  helia-server:express Fetching from Helia: /ipns/blog.libp2p.io/assets/img/libp2p_http.d5e34487.png +0ms
  helia-server:express:helia-fetch Fetching: /ipns/blog.libp2p.io/assets/img/libp2p_http.d5e34487.png +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/img/libp2p_http.d5e34487.png +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/libp2p_http.d5e34487.png'
} +0ms
  helia-server:express:helia-fetch Processing Fetch: {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/libp2p_http.d5e34487.png'
} +0ms
  helia-server:express:helia-fetch Final IPFS path: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/libp2p_http.d5e34487.png +0ms
  helia-server:express:helia-fetch Fetching: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/libp2p_http.d5e34487.png +0ms
  helia-server:express:helia-fetch Parsing path: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/libp2p_http.d5e34487.png +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipfs',
  address: 'QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN',
  relativePath: '/assets/img/libp2p_http.d5e34487.png'
} +0ms
  helia-server:express:helia-fetch Processing Fetch: {
  namespace: 'ipfs',
  address: 'QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN',
  relativePath: '/assets/img/libp2p_http.d5e34487.png'
} +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/img/crypto_tls_header.21e9628e.png +459ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/crypto_tls_header.21e9628e.png'
} +0ms
  helia-server:express Referer found: http://localhost:8888/ipns/blog.libp2p.io +459ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: ''
} +0ms
  helia-server:express Requesting content from helia: /ipns/blog.libp2p.io/assets/img/crypto_tls_header.21e9628e.png +1ms
  helia-server:express Fetching from Helia: /ipns/blog.libp2p.io/assets/img/crypto_tls_header.21e9628e.png +0ms
  helia-server:express:helia-fetch Fetching: /ipns/blog.libp2p.io/assets/img/crypto_tls_header.21e9628e.png +1ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/img/crypto_tls_header.21e9628e.png +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/crypto_tls_header.21e9628e.png'
} +0ms
  helia-server:express:helia-fetch Processing Fetch: {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/crypto_tls_header.21e9628e.png'
} +0ms
  helia-server:express:helia-fetch Final IPFS path: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/crypto_tls_header.21e9628e.png +0ms
  helia-server:express:helia-fetch Fetching: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/crypto_tls_header.21e9628e.png +0ms
  helia-server:express:helia-fetch Parsing path: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/crypto_tls_header.21e9628e.png +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipfs',
  address: 'QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN',
  relativePath: '/assets/img/crypto_tls_header.21e9628e.png'
} +0ms
  helia-server:express:helia-fetch Processing Fetch: {
  namespace: 'ipfs',
  address: 'QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN',
  relativePath: '/assets/img/crypto_tls_header.21e9628e.png'
} +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/img/blog-post-placeholder.af417eb0.png +393ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/blog-post-placeholder.af417eb0.png'
} +0ms
  helia-server:express Referer found: http://localhost:8888/ipns/blog.libp2p.io +393ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: ''
} +0ms
  helia-server:express Requesting content from helia: /ipns/blog.libp2p.io/assets/img/blog-post-placeholder.af417eb0.png +1ms
  helia-server:express Fetching from Helia: /ipns/blog.libp2p.io/assets/img/blog-post-placeholder.af417eb0.png +0ms
  helia-server:express:helia-fetch Fetching: /ipns/blog.libp2p.io/assets/img/blog-post-placeholder.af417eb0.png +1ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/img/blog-post-placeholder.af417eb0.png +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/blog-post-placeholder.af417eb0.png'
} +0ms
  helia-server:express:helia-fetch Processing Fetch: {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/blog-post-placeholder.af417eb0.png'
} +0ms
  helia-server:express:helia-fetch Final IPFS path: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/blog-post-placeholder.af417eb0.png +0ms
  helia-server:express:helia-fetch Fetching: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/blog-post-placeholder.af417eb0.png +0ms
  helia-server:express:helia-fetch Parsing path: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/blog-post-placeholder.af417eb0.png +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipfs',
  address: 'QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN',
  relativePath: '/assets/img/blog-post-placeholder.af417eb0.png'
} +0ms
  helia-server:express:helia-fetch Processing Fetch: {
  namespace: 'ipfs',
  address: 'QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN',
  relativePath: '/assets/img/blog-post-placeholder.af417eb0.png'
} +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/img/metrics-in-go-libp2p-header.83e639cd.png +467ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/metrics-in-go-libp2p-header.83e639cd.png'
} +0ms
  helia-server:express Referer found: http://localhost:8888/ipns/blog.libp2p.io +467ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: ''
} +0ms
  helia-server:express Requesting content from helia: /ipns/blog.libp2p.io/assets/img/metrics-in-go-libp2p-header.83e639cd.png +0ms
  helia-server:express Fetching from Helia: /ipns/blog.libp2p.io/assets/img/metrics-in-go-libp2p-header.83e639cd.png +0ms
  helia-server:express:helia-fetch Fetching: /ipns/blog.libp2p.io/assets/img/metrics-in-go-libp2p-header.83e639cd.png +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/img/metrics-in-go-libp2p-header.83e639cd.png +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/metrics-in-go-libp2p-header.83e639cd.png'
} +0ms
  helia-server:express:helia-fetch Processing Fetch: {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/metrics-in-go-libp2p-header.83e639cd.png'
} +0ms
  helia-server:express:helia-fetch Final IPFS path: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/metrics-in-go-libp2p-header.83e639cd.png +0ms
  helia-server:express:helia-fetch Fetching: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/metrics-in-go-libp2p-header.83e639cd.png +0ms
  helia-server:express:helia-fetch Parsing path: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/metrics-in-go-libp2p-header.83e639cd.png +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipfs',
  address: 'QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN',
  relativePath: '/assets/img/metrics-in-go-libp2p-header.83e639cd.png'
} +0ms
  helia-server:express:helia-fetch Processing Fetch: {
  namespace: 'ipfs',
  address: 'QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN',
  relativePath: '/assets/img/metrics-in-go-libp2p-header.83e639cd.png'
} +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/img/interop-testing.efd81a25.png +415ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/interop-testing.efd81a25.png'
} +0ms
  helia-server:express Referer found: http://localhost:8888/ipns/blog.libp2p.io +415ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: ''
} +0ms
  helia-server:express Requesting content from helia: /ipns/blog.libp2p.io/assets/img/interop-testing.efd81a25.png +0ms
  helia-server:express Fetching from Helia: /ipns/blog.libp2p.io/assets/img/interop-testing.efd81a25.png +0ms
  helia-server:express:helia-fetch Fetching: /ipns/blog.libp2p.io/assets/img/interop-testing.efd81a25.png +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/img/interop-testing.efd81a25.png +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/interop-testing.efd81a25.png'
} +0ms
  helia-server:express:helia-fetch Processing Fetch: {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/interop-testing.efd81a25.png'
} +0ms
  helia-server:express:helia-fetch Final IPFS path: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/interop-testing.efd81a25.png +0ms
  helia-server:express:helia-fetch Fetching: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/interop-testing.efd81a25.png +0ms
  helia-server:express:helia-fetch Parsing path: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/interop-testing.efd81a25.png +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipfs',
  address: 'QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN',
  relativePath: '/assets/img/interop-testing.efd81a25.png'
} +0ms
  helia-server:express:helia-fetch Processing Fetch: {
  namespace: 'ipfs',
  address: 'QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN',
  relativePath: '/assets/img/interop-testing.efd81a25.png'
} +0ms
  helia-server:express:helia-fetch Fetching from IPFS: {
  cid: CID(QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN),
  type: 'file',
  options: { path: '/assets/img/blog-post-placeholder.af417eb0.png' }
} +22s
  helia-server:express:helia-fetch Getting file response: {
  cid: CID(QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN),
  options: { path: '/assets/img/blog-post-placeholder.af417eb0.png' }
} +1ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/img/blog-post-placeholder.af417eb0.png +25ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/blog-post-placeholder.af417eb0.png'
} +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/site.webmanifest +596ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'site.webmanifest',
  relativePath: ''
} +0ms
  helia-server:express Referer found: http://localhost:8888/ipns/blog.libp2p.io +22s
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: ''
} +0ms
  helia-server:express Redirecting to final URL: http://localhost:8888/ipns/blog.libp2p.io/site.webmanifest +0ms
(node:92038) MaxListenersExceededWarning: Possible EventTarget memory leak detected. 11 abort listeners added to [AbortSignal]. Use events.setMaxListeners() to increase limit
    at [kNewListener] (node:internal/event_target:527:17)
    at [kNewListener] (node:internal/abort_controller:239:24)
    at EventTarget.addEventListener (node:internal/event_target:638:23)
    at anySignal (file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/any-signal/dist/src/index.js:21:20)
    at DialQueue.createDialAbortControllers (file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/libp2p/dist/src/connection-manager/dial-queue.js:200:24)
    at DialQueue.dial (file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/libp2p/dist/src/connection-manager/dial-queue.js:123:29)
    at DefaultConnectionManager.openConnection (file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/libp2p/dist/src/connection-manager/index.js:312:49)
    at Libp2pNode.dial (file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/libp2p/dist/src/libp2p.js:224:50)
    at Network.connectTo (file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/ipfs-bitswap/dist/src/network.js:186:29)
    at MsgQueue.send (file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/ipfs-bitswap/dist/src/want-manager/msg-queue.js:47:32)
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/img/libp2p_WebRTC_blog_header.7f5f55e7.png +800ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/libp2p_WebRTC_blog_header.7f5f55e7.png'
} +0ms
  helia-server:express Referer found: http://localhost:8888/ipns/blog.libp2p.io +800ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: ''
} +1ms
  helia-server:express Requesting content from helia: /ipns/blog.libp2p.io/assets/img/libp2p_WebRTC_blog_header.7f5f55e7.png +1ms
  helia-server:express Fetching from Helia: /ipns/blog.libp2p.io/assets/img/libp2p_WebRTC_blog_header.7f5f55e7.png +0ms
  helia-server:express:helia-fetch Fetching: /ipns/blog.libp2p.io/assets/img/libp2p_WebRTC_blog_header.7f5f55e7.png +0ms
  helia-server:express:helia-fetch Parsing path: /ipns/blog.libp2p.io/assets/img/libp2p_WebRTC_blog_header.7f5f55e7.png +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/libp2p_WebRTC_blog_header.7f5f55e7.png'
} +0ms
  helia-server:express:helia-fetch Processing Fetch: {
  namespace: 'ipns',
  address: 'blog.libp2p.io',
  relativePath: '/assets/img/libp2p_WebRTC_blog_header.7f5f55e7.png'
} +0ms
  helia-server:express:helia-fetch Final IPFS path: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/libp2p_WebRTC_blog_header.7f5f55e7.png +0ms
  helia-server:express:helia-fetch Fetching: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/libp2p_WebRTC_blog_header.7f5f55e7.png +0ms
  helia-server:express:helia-fetch Parsing path: /ipfs/QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN/assets/img/libp2p_WebRTC_blog_header.7f5f55e7.png +0ms
  helia-server:express:helia-fetch Parsed path: [Object: null prototype] {
  namespace: 'ipfs',
  address: 'QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN',
  relativePath: '/assets/img/libp2p_WebRTC_blog_header.7f5f55e7.png'
} +0ms
  helia-server:express:helia-fetch Processing Fetch: {
  namespace: 'ipfs',
  address: 'QmZUq695FkZgbBYYvaTXvjD3LeZPSkfxhWD8BFGQTZBhvN',
  relativePath: '/assets/img/libp2p_WebRTC_blog_header.7f5f55e7.png'
} +0ms
(node:92038) MaxListenersExceededWarning: Possible EventTarget memory leak detected. 11 abort listeners added to [AbortSignal]. Use events.setMaxListeners() to increase limit
    at [kNewListener] (node:internal/event_target:527:17)
    at [kNewListener] (node:internal/abort_controller:239:24)
    at EventTarget.addEventListener (node:internal/event_target:638:23)
    at anySignal (file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/any-signal/dist/src/index.js:21:20)
    at DialQueue.createDialAbortControllers (file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/libp2p/dist/src/connection-manager/dial-queue.js:200:24)
    at DialQueue.dial (file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/libp2p/dist/src/connection-manager/dial-queue.js:123:29)
    at DefaultConnectionManager.openConnection (file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/libp2p/dist/src/connection-manager/index.js:312:49)
    at Libp2pNode.dial (file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/libp2p/dist/src/libp2p.js:224:50)
    at Network.connectTo (file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/ipfs-bitswap/dist/src/network.js:186:29)
    at MsgQueue.send (file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-docker/node_modules/ipfs-bitswap/dist/src/want-manager/msg-queue.js:47:32)

[SgtPooki]

the docker container seems more stable now, but we might want to recommend running it in tiros with USE_LIBP2P=false USE_BITSWAP=false for now to keep mem usage & cpu low

[SgtPooki]

I was able to get an error just in the node runtime by running npm run start in one terminal, and then the following script in another:

#!/usr/bin/env bash

# Query all endpoints until failure
# This script is intended to be run from the root of the helia-http-gateway repository

mkdir -p test-output

wget -T 180 -O test-output/blog.ipfs.tech http://localhost:8080/ipns/blog.ipfs.tech
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/blog.libp2p.io http://localhost:8080/ipns/blog.libp2p.io
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/consensuslab.world http://localhost:8080/ipns/consensuslab.world
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/docs.ipfs.tech http://localhost:8080/ipns/docs.ipfs.tech
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/docs.libp2p.io http://localhost:8080/ipns/docs.libp2p.io
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/drand.love http://localhost:8080/ipns/drand.love
curl -X POST http://localhost:8080/api/v0/repo/gc

# wg -O test-output/fil.orget http://localhost:8080/ipns/fil.org
# curl -X POST http://localhost:8080/api/v0/repo/gc
#
wget -T 180 -O test-output/filecoin.io http://localhost:8080/ipns/filecoin.io
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/green.filecoin.io http://localhost:8080/ipns/green.filecoin.io
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/ipfs.tech http://localhost:8080/ipns/ipfs.tech
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/ipld.io http://localhost:8080/ipns/ipld.io
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/libp2p.io http://localhost:8080/ipns/libp2p.io
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/n0.computer http://localhost:8080/ipns/n0.computer
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/probelab.io http://localhost:8080/ipns/probelab.io
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/protocol.ai http://localhost:8080/ipns/protocol.ai
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/research.protocol.ai http://localhost:8080/ipns/research.protocol.ai
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/singularity.storage http://localhost:8080/ipns/singularity.storage
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/specs.ipfs.tech http://localhost:8080/ipns/specs.ipfs.tech
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/strn.network http://localhost:8080/ipns/strn.network
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/web3.storage http://localhost:8080/ipns/web3.storage
curl -X POST http://localhost:8080/api/v0/repo/gc

rm -rf test-output

The error output was:

[10:22:36.275] INFO (57554): helia-http-gateway:fastifyincoming request
    reqId: "req-f"
    req: {
      "method": "GET",
      "url": "/ipns/green.filecoin.io",
      "hostname": "localhost:8080",
      "remoteAddress": "127.0.0.1",
      "remotePort": 58478
    }
(node:57554) MaxListenersExceededWarning: Possible EventTarget memory leak detected. 11 abort listeners added to [AbortSignal]. Use events.setMaxListeners() to increase limit
file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-http-gateway/node_modules/@libp2p/webrtc/dist/src/private-to-private/handler.js:21
            connectedPromise.reject(new CodeError('Timed out while trying to connect', 'ERR_TIMEOUT'));
                                    ^

CodeError: Timed out while trying to connect
    at signal.onabort (file:///Users/sgtpooki/code/work/protocol.ai/ipfs/helia-http-gateway/node_modules/@libp2p/webrtc/dist/src/private-to-private/handler.js:21:37)
    at EventTarget.eventHandler (node:internal/event_target:1093:12)
    at [nodejs.internal.kHybridDispatch] (node:internal/event_target:807:20)
    at EventTarget.dispatchEvent (node:internal/event_target:742:26)
    at abortSignal (node:internal/abort_controller:369:10)
    at Timeout._onTimeout (node:internal/abort_controller:126:7)
    at listOnTimeout (node:internal/timers:573:17)
    at process.processTimers (node:internal/timers:514:7) {
  code: 'ERR_TIMEOUT',
  props: {}
}

[SgtPooki]

I'm running the above script, with a minor edit, using https://www.npmjs.com/package/until-death, to try to kill the helia-http-gateway with npx -y until-death ./test-gateway.sh

The script is as follows:

#!/usr/bin/env bash
# test-gateway.sh

# Query all endpoints until failure
# This script is intended to be run from the root of the helia-http-gateway repository

# If localhost:8080 is not listening, then exit with non-zero error code
if ! nc -z localhost 8080; then
  echo "localhost:8080 is not listening"
  exit 1
fi

mkdir -p test-output

wget -T 180 -O test-output/blog.ipfs.tech http://localhost:8080/ipns/blog.ipfs.tech
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/blog.libp2p.io http://localhost:8080/ipns/blog.libp2p.io
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/consensuslab.world http://localhost:8080/ipns/consensuslab.world
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/docs.ipfs.tech http://localhost:8080/ipns/docs.ipfs.tech
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/docs.libp2p.io http://localhost:8080/ipns/docs.libp2p.io
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/drand.love http://localhost:8080/ipns/drand.love
curl -X POST http://localhost:8080/api/v0/repo/gc

# wg -O test-output/fil.orget http://localhost:8080/ipns/fil.org
# curl -X POST http://localhost:8080/api/v0/repo/gc
#
wget -T 180 -O test-output/filecoin.io http://localhost:8080/ipns/filecoin.io
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/green.filecoin.io http://localhost:8080/ipns/green.filecoin.io
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/ipfs.tech http://localhost:8080/ipns/ipfs.tech
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/ipld.io http://localhost:8080/ipns/ipld.io
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/libp2p.io http://localhost:8080/ipns/libp2p.io
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/n0.computer http://localhost:8080/ipns/n0.computer
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/probelab.io http://localhost:8080/ipns/probelab.io
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/protocol.ai http://localhost:8080/ipns/protocol.ai
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/research.protocol.ai http://localhost:8080/ipns/research.protocol.ai
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/singularity.storage http://localhost:8080/ipns/singularity.storage
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/specs.ipfs.tech http://localhost:8080/ipns/specs.ipfs.tech
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/strn.network http://localhost:8080/ipns/strn.network
curl -X POST http://localhost:8080/api/v0/repo/gc

wget -T 180 -O test-output/web3.storage http://localhost:8080/ipns/web3.storage
curl -X POST http://localhost:8080/api/v0/repo/gc

rm -rf test-output

[SgtPooki]

I was able to kill it with the above method, getting a JS heap out of memory error:

[10:41:38.968] INFO (62069): helia-http-gateway:fastifyincoming request
    reqId: "req-1l"
    req: {
      "method": "GET",
      "url": "/ipns/filecoin.io",
      "hostname": "localhost:8080",
      "remoteAddress": "127.0.0.1",
      "remotePort": 61865
    }
(node:62069) MaxListenersExceededWarning: Possible EventTarget memory leak detected. 11 abort listeners added to [AbortSignal]. Use events.setMaxListeners() to increase limit
(node:62069) MaxListenersExceededWarning: Possible EventTarget memory leak detected. 11 abort listeners added to [AbortSignal]. Use events.setMaxListeners() to increase limit
[10:41:49.224] INFO (62069): helia-http-gateway:fastifyrequest completed
    reqId: "req-1l"
    res: {
      "statusCode": 200
    }
    responseTime: 10255.209916949272

<--- Last few GCs --->

[62069:0x128008000]   736550 ms: Scavenge 3985.7 (4127.4) -> 3974.5 (4127.4) MB, 10.92 / 0.12 ms  (average mu = 0.204, current mu = 0.017) allocation failure;
[62069:0x128008000]   736573 ms: Scavenge 3988.0 (4127.6) -> 3977.8 (4128.6) MB, 11.12 / 0.08 ms  (average mu = 0.204, current mu = 0.017) allocation failure;
[62069:0x128008000]   737515 ms: Mark-Compact 3990.1 (4128.6) -> 3897.5 (4129.4) MB, 935.08 / 0.00 ms  (average mu = 0.342, current mu = 0.458) allocation failure; scavenge might not succeed


<--- JS stacktrace --->

FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
 1: 0x1044060f0 node::Abort() [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
 2: 0x1044062d8 node::ModifyCodeGenerationFromStrings(v8::Local<v8::Context>, v8::Local<v8::Value>, bool) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
 3: 0x10458ce98 v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, v8::OOMDetails const&) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
 4: 0x10476167c v8::internal::Heap::GarbageCollectionReasonToString(v8::internal::GarbageCollectionReason) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
 5: 0x104765530 v8::internal::Heap::CollectGarbageShared(v8::internal::LocalHeap*, v8::internal::GarbageCollectionReason) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
 6: 0x104761f94 v8::internal::Heap::PerformGarbageCollection(v8::internal::GarbageCollector, v8::internal::GarbageCollectionReason, char const*) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
 7: 0x10475fd1c v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
 8: 0x104756970 v8::internal::HeapAllocator::AllocateRawWithLightRetrySlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
 9: 0x1047571d0 v8::internal::HeapAllocator::AllocateRawWithRetryOrFailSlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
10: 0x10473c1d4 v8::internal::Factory::NewFillerObject(int, v8::internal::AllocationAlignment, v8::internal::AllocationType, v8::internal::AllocationOrigin) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
11: 0x104b23be4 v8::internal::Runtime_AllocateInYoungGeneration(int, unsigned long*, v8::internal::Isolate*) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
12: 0x104e80c44 Builtins_CEntry_Return1_ArgvOnStack_NoBuiltinExit [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
13: 0x104ed00e8 Builtins_NumberPrototypeToString [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
14: 0x10a00d09c
15: 0x109fe513c
16: 0x10a2b4398
17: 0x109e9ee60
18: 0x104e2f210 Builtins_AsyncFunctionAwaitResolveClosure [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
19: 0x104edcfb8 Builtins_PromiseFulfillReactionJob [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
20: 0x104e1eb94 Builtins_RunMicrotasks [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
21: 0x104df63f4 Builtins_JSRunMicrotasksEntry [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
22: 0x1046ceae4 v8::internal::(anonymous namespace)::Invoke(v8::internal::Isolate*, v8::internal::(anonymous namespace)::InvokeParams const&) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
23: 0x1046cefd0 v8::internal::(anonymous namespace)::InvokeWithTryCatch(v8::internal::Isolate*, v8::internal::(anonymous namespace)::InvokeParams const&) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
24: 0x1046cf1ac v8::internal::Execution::TryRunMicrotasks(v8::internal::Isolate*, v8::internal::MicrotaskQueue*) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
25: 0x1046f6268 v8::internal::MicrotaskQueue::RunMicrotasks(v8::internal::Isolate*) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
26: 0x1046f6a04 v8::internal::MicrotaskQueue::PerformCheckpoint(v8::Isolate*) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
27: 0x104df9ef0 Builtins_CallApiCallback [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
28: 0x10a1b7614
29: 0x104df650c Builtins_JSEntryTrampoline [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
30: 0x104df61f4 Builtins_JSEntry [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
31: 0x1046ceb0c v8::internal::(anonymous namespace)::Invoke(v8::internal::Isolate*, v8::internal::(anonymous namespace)::InvokeParams const&) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
32: 0x1046cdf58 v8::internal::Execution::Call(v8::internal::Isolate*, v8::internal::Handle<v8::internal::Object>, v8::internal::Handle<v8::internal::Object>, int, v8::internal::Handle<v8::internal::Object>*) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
33: 0x1045a8824 v8::Function::Call(v8::Local<v8::Context>, v8::Local<v8::Value>, int, v8::Local<v8::Value>*) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
34: 0x104338d3c node::InternalCallbackScope::Close() [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
35: 0x10433901c node::InternalMakeCallback(node::Environment*, v8::Local<v8::Object>, v8::Local<v8::Object>, v8::Local<v8::Function>, int, v8::Local<v8::Value>*, node::async_context) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
36: 0x10434f48c node::AsyncWrap::MakeCallback(v8::Local<v8::Function>, int, v8::Local<v8::Value>*) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
37: 0x1044d2ff4 node::StreamBase::CallJSOnreadMethod(long, v8::Local<v8::ArrayBuffer>, unsigned long, node::StreamBase::StreamBaseJSChecks) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
38: 0x1044d4688 node::EmitToJSStreamListener::OnStreamRead(long, uv_buf_t const&) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
39: 0x1044d897c node::LibuvStreamWrap::OnUvRead(long, uv_buf_t const*) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
40: 0x1044d9100 node::LibuvStreamWrap::ReadStart()::$_1::__invoke(uv_stream_s*, long, uv_buf_t const*) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
41: 0x104de2dc0 uv__stream_io [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
42: 0x104dea6c4 uv__io_poll [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
43: 0x104dd8bb0 uv_run [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
44: 0x104339754 node::SpinEventLoopInternal(node::Environment*) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
45: 0x104449114 node::NodeMainInstance::Run(node::ExitCode*, node::Environment*) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
46: 0x104448eb0 node::NodeMainInstance::Run() [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
47: 0x1043d160c node::Start(int, char**) [/Users/sgtpooki/.asdf/installs/nodejs/20.8.1/bin/node]
48: 0x1a0d4bf28 start [/usr/lib/dyld]
[1]    62030 abort      DEBUG="helia-server" npm run start                                  [12m19.054s]

[SgtPooki]

i've got those scripts in a debugging folder and will be pushing those up in a PR shortly with some additional fixes.

[SgtPooki]

seems like the container and node.js process has been significantly improved on my local branch. changes coming after an event at my sons school. here's some output:

Requesting http://localhost:8080/ipns/blog.ipfs.tech
http://localhost:8080/ipns/blog.ipfs.tech: HTTP_000 in 60.001766 seconds
Connection to localhost port 8080 [tcp/http-alt] succeeded!
Requesting http://localhost:8080/ipns/blog.ipfs.tech
http://localhost:8080/ipns/blog.ipfs.tech: HTTP_200 in 11.146163 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.996113 seconds
Requesting http://localhost:8080/ipns/blog.libp2p.io
http://localhost:8080/ipns/blog.libp2p.io: HTTP_200 in 5.834325 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.561062 seconds
Requesting http://localhost:8080/ipns/consensuslab.world
http://localhost:8080/ipns/consensuslab.world: HTTP_200 in 2.157051 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.445670 seconds
Requesting http://localhost:8080/ipns/docs.ipfs.tech
http://localhost:8080/ipns/docs.ipfs.tech: HTTP_200 in 4.262585 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.278778 seconds
Requesting http://localhost:8080/ipns/docs.libp2p.io
http://localhost:8080/ipns/docs.libp2p.io: HTTP_200 in 2.769344 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.544346 seconds
Requesting http://localhost:8080/ipns/drand.love
http://localhost:8080/ipns/drand.love: HTTP_200 in 3.396503 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.447386 seconds
Requesting http://localhost:8080/ipns/fil.org
http://localhost:8080/ipns/fil.org: HTTP_200 in 5.396954 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.358178 seconds
Requesting http://localhost:8080/ipns/filecoin.io
http://localhost:8080/ipns/filecoin.io: HTTP_200 in 4.708792 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.511910 seconds
Requesting http://localhost:8080/ipns/green.filecoin.io
http://localhost:8080/ipns/green.filecoin.io: HTTP_200 in 3.592724 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.468012 seconds
Requesting http://localhost:8080/ipns/ipfs.tech
http://localhost:8080/ipns/ipfs.tech: HTTP_200 in 3.181904 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.545069 seconds
Requesting http://localhost:8080/ipns/ipld.io
http://localhost:8080/ipns/ipld.io: HTTP_200 in 2.365077 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.540125 seconds
Requesting http://localhost:8080/ipns/libp2p.io
http://localhost:8080/ipns/libp2p.io: HTTP_200 in 1.943017 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.511259 seconds
Requesting http://localhost:8080/ipns/n0.computer
http://localhost:8080/ipns/n0.computer: HTTP_200 in 1.756028 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.508440 seconds
Requesting http://localhost:8080/ipns/probelab.io
http://localhost:8080/ipns/probelab.io: HTTP_200 in 2.947130 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.596525 seconds
Requesting http://localhost:8080/ipns/protocol.ai
http://localhost:8080/ipns/protocol.ai: HTTP_200 in 3.955738 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.498988 seconds
Requesting http://localhost:8080/ipns/research.protocol.ai
http://localhost:8080/ipns/research.protocol.ai: HTTP_200 in 4.346949 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.509931 seconds
Requesting http://localhost:8080/ipns/singularity.storage
http://localhost:8080/ipns/singularity.storage: HTTP_200 in 3.208631 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.367448 seconds
Requesting http://localhost:8080/ipns/specs.ipfs.tech
http://localhost:8080/ipns/specs.ipfs.tech: HTTP_200 in 1.827266 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.462614 seconds
Requesting http://localhost:8080/ipns/strn.network
http://localhost:8080/ipns/strn.network: HTTP_200 in 7.334869 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.755269 seconds
Requesting http://localhost:8080/ipns/web3.storage
http://localhost:8080/ipns/web3.storage: HTTP_200 in 4.347730 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.150839 seconds
Connection to localhost port 8080 [tcp/http-alt] succeeded!
Requesting http://localhost:8080/ipns/blog.ipfs.tech
http://localhost:8080/ipns/blog.ipfs.tech: HTTP_200 in 49.758429 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.991985 seconds
Requesting http://localhost:8080/ipns/blog.libp2p.io
http://localhost:8080/ipns/blog.libp2p.io: HTTP_200 in 14.113579 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 2.558124 seconds
Requesting http://localhost:8080/ipns/consensuslab.world
http://localhost:8080/ipns/consensuslab.world: HTTP_200 in 5.889396 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.970621 seconds
Requesting http://localhost:8080/ipns/docs.ipfs.tech
http://localhost:8080/ipns/docs.ipfs.tech: HTTP_200 in 4.888529 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.765097 seconds
Requesting http://localhost:8080/ipns/docs.libp2p.io
http://localhost:8080/ipns/docs.libp2p.io: HTTP_200 in 4.747674 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.754912 seconds
Requesting http://localhost:8080/ipns/drand.love
http://localhost:8080/ipns/drand.love: HTTP_200 in 3.807516 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.403479 seconds
Requesting http://localhost:8080/ipns/fil.org
http://localhost:8080/ipns/fil.org: HTTP_200 in 5.218964 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.413936 seconds
Requesting http://localhost:8080/ipns/filecoin.io
http://localhost:8080/ipns/filecoin.io: HTTP_200 in 4.279419 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 1.098515 seconds
Requesting http://localhost:8080/ipns/green.filecoin.io
http://localhost:8080/ipns/green.filecoin.io: HTTP_200 in 3.925621 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.499890 seconds
Requesting http://localhost:8080/ipns/ipfs.tech
http://localhost:8080/ipns/ipfs.tech: HTTP_200 in 3.069305 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.459704 seconds
Requesting http://localhost:8080/ipns/ipld.io
http://localhost:8080/ipns/ipld.io: HTTP_200 in 1.957165 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.431254 seconds
Requesting http://localhost:8080/ipns/libp2p.io
http://localhost:8080/ipns/libp2p.io: HTTP_200 in 1.677803 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.361421 seconds
Requesting http://localhost:8080/ipns/n0.computer
http://localhost:8080/ipns/n0.computer: HTTP_200 in 1.866869 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.343904 seconds
Requesting http://localhost:8080/ipns/probelab.io
http://localhost:8080/ipns/probelab.io: HTTP_200 in 3.967132 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.490225 seconds
Requesting http://localhost:8080/ipns/protocol.ai
http://localhost:8080/ipns/protocol.ai: HTTP_200 in 5.048833 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.792142 seconds
Requesting http://localhost:8080/ipns/research.protocol.ai
http://localhost:8080/ipns/research.protocol.ai: HTTP_200 in 4.113244 seconds
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.870508 seconds

[SgtPooki]

USE_LIBP2P=false & USE_BITSWAP=false significantly improve TTFB metrics:

Requesting http://localhost:8080/ipns/blog.ipfs.tech
http://localhost:8080/ipns/blog.ipfs.tech: HTTP_200 in 33.389076 seconds (TTFB: 33.388933, rediect: 0.005276)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.201580 seconds
Requesting http://localhost:8080/ipns/blog.libp2p.io
http://localhost:8080/ipns/blog.libp2p.io: HTTP_200 in 0.538736 seconds (TTFB: 0.538635, rediect: 0.012172)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.004971 seconds
Requesting http://localhost:8080/ipns/consensuslab.world
http://localhost:8080/ipns/consensuslab.world: HTTP_200 in 0.383609 seconds (TTFB: 0.383476, rediect: 0.005460)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.007073 seconds
Requesting http://localhost:8080/ipns/docs.ipfs.tech
http://localhost:8080/ipns/docs.ipfs.tech: HTTP_200 in 0.392974 seconds (TTFB: 0.392633, rediect: 0.005721)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.005923 seconds
Requesting http://localhost:8080/ipns/docs.libp2p.io
http://localhost:8080/ipns/docs.libp2p.io: HTTP_200 in 0.620038 seconds (TTFB: 0.619875, rediect: 0.005116)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.007380 seconds
Requesting http://localhost:8080/ipns/drand.love
http://localhost:8080/ipns/drand.love: HTTP_200 in 0.393777 seconds (TTFB: 0.393676, rediect: 0.005175)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.004635 seconds
Requesting http://localhost:8080/ipns/fil.org
http://localhost:8080/ipns/fil.org: HTTP_200 in 0.321622 seconds (TTFB: 0.321465, rediect: 0.003620)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.028887 seconds
Requesting http://localhost:8080/ipns/filecoin.io
http://localhost:8080/ipns/filecoin.io: HTTP_200 in 0.887135 seconds (TTFB: 0.886964, rediect: 0.004776)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.035565 seconds
Requesting http://localhost:8080/ipns/green.filecoin.io
http://localhost:8080/ipns/green.filecoin.io: HTTP_200 in 0.558634 seconds (TTFB: 0.558494, rediect: 0.004851)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.431983 seconds
Requesting http://localhost:8080/ipns/ipfs.tech
http://localhost:8080/ipns/ipfs.tech: HTTP_200 in 0.516234 seconds (TTFB: 0.516087, rediect: 0.008784)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.203987 seconds
Requesting http://localhost:8080/ipns/ipld.io
http://localhost:8080/ipns/ipld.io: HTTP_200 in 0.486826 seconds (TTFB: 0.486535, rediect: 0.009419)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.010074 seconds
Requesting http://localhost:8080/ipns/libp2p.io
http://localhost:8080/ipns/libp2p.io: HTTP_200 in 0.301976 seconds (TTFB: 0.301752, rediect: 0.005911)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.191732 seconds
Requesting http://localhost:8080/ipns/n0.computer
http://localhost:8080/ipns/n0.computer: HTTP_200 in 0.460659 seconds (TTFB: 0.460371, rediect: 0.009132)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.007510 seconds
Requesting http://localhost:8080/ipns/probelab.io
http://localhost:8080/ipns/probelab.io: HTTP_200 in 0.395654 seconds (TTFB: 0.395505, rediect: 0.006490)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.184738 seconds
Requesting http://localhost:8080/ipns/protocol.ai
http://localhost:8080/ipns/protocol.ai: HTTP_200 in 0.298125 seconds (TTFB: 0.297968, rediect: 0.006809)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.084095 seconds
Requesting http://localhost:8080/ipns/research.protocol.ai
http://localhost:8080/ipns/research.protocol.ai: HTTP_200 in 0.611435 seconds (TTFB: 0.611299, rediect: 0.006365)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.487283 seconds
Requesting http://localhost:8080/ipns/singularity.storage
http://localhost:8080/ipns/singularity.storage: HTTP_200 in 0.866055 seconds (TTFB: 0.865264, rediect: 0.019014)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.007395 seconds
Requesting http://localhost:8080/ipns/specs.ipfs.tech
http://localhost:8080/ipns/specs.ipfs.tech: HTTP_200 in 0.368673 seconds (TTFB: 0.368238, rediect: 0.006296)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.013496 seconds
Requesting http://localhost:8080/ipns/strn.network
http://localhost:8080/ipns/strn.network: HTTP_200 in 0.661367 seconds (TTFB: 0.661232, rediect: 0.008505)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.522674 seconds
Requesting http://localhost:8080/ipns/web3.storage
http://localhost:8080/ipns/web3.storage: HTTP_200 in 0.385475 seconds (TTFB: 0.385260, rediect: 0.007811)
running GC
http://localhost:8080/api/v0/repo/gc: HTTP_200 in 0.392009 seconds

[SgtPooki]

We need to move away from using an in-memory data-store because there is no way to limit the amount of memory used. @wemeetagain mentioned that Lodestar uses an in-mem datastore that flushes to file-system.

If lodestar has a datastore we can use, we should use that, otherwise we should migrate to use file-system directly and then update to use lodestar strategy.