Hailo-10 can run Llama2-7B with up to 10 tokens per second at under 5W of power and produce an image from Stable Diffusion 2.1 in under five seconds. Read Full Article
Originally appeared on: TheSpuzz
Hailo-10 can run Llama2-7B with up to 10 tokens per second at under 5W of power and produce an image from Stable Diffusion 2.1 in under five seconds. Read Full Article