> ## Documentation Index
> Fetch the complete documentation index at: https://fireworks.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Does the API support batching and load balancing?

Current capabilities include:

* **Load balancing**: Yes, supported out of the box
* **Continuous batching**: Yes, supported
* **Batch inference**: Yes, supported via the [Batch API](https://fireworks.ai/docs/guides/batch-inference.md)
* **Streaming**: Yes, supported

For asynchronous batch processing of large volumes of requests, see our [Batch API documentation](https://fireworks.ai/docs/guides/batch-inference.md).


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.