Choosing a Generative AI Inference Cloud for your Robotic Solution

Let us examine the performance of services providing inference on Large Language Models (LLMs)

Introduction

The fields of robotics and Generative Artificial Intelligence (GenAI) are rapidly intersecting… robots are becoming more and more capable, yet need a knowledge bank to understand the world around it. Multimodal Large Language Models (LLMs) such as LLaVA can provide answers to things that robots needs to understand, such as understanding a picture taken by the camera, or responding to data measured by a sensor. Other ways in which Generative AI can help robots are by generating image sequence datasets which can be then used to train robots. We are excited by the possibilities that the intersection of these two different but related research streams can bring.

In this post, we will discuss how to evaluate different cloud based services that offer generative AI solutions. The evaluation is not particularly limited to the field of robotics, it is generic to other solutions which need LLMs. So, if your use case needs inference from LLMs, read on.

Cloud Services for LLM Inference

…