Show HN: Spinf-serve – inference server for bulk scoring and decisions
7 points by giarec
Spinf-serve is an inference server designed for bulk classification and decision-making using a single GPU, allowing multiple questions about the same content to be scored in one pass. It is compatible with OpenAI and released under the Apache 2.0 license.