Generic worker pool

Go (1.18+) framework to run a pool of N workers

go get github.com/quakephil/[email protected]

Pool

• shared input/output channels

workers := pool.New[I, O](input, worker, output)

• channel synchronization for
  • concurrent runs of Process()
  • completion of Output()

result := workers.Wait(concurrency)

Input

func input(in chan<- I) {
  for ... {
    in <- I{ ... }
  }  
}

Worker

func worker(i I) I {
  i.update = ...
  return i
}

Output

func output(results <-chan I) (out O) {
  for result := range results {
    out.update += ...
  }
  return
}

Examples: https://github.com/QuakePhil/generic-worker-pool-examples