Blog

In this video demo, profiq engineer Viktor Nawrath explores the intricacies and the realities of AI Computer Use, offering viewers a better understanding of what is possible when applying language models to control their computers and the benefits of doing so. Learn how AI can interact with computers as a human would, highlighting the strengths, challenges, and future developments of this technology. Highlights from the demo: AI-Powered Computer Control: Overview of using language models to automate tasks and control a computer. Evolution from HTML to Visual-Based Automation: Transition from text-based…

Testing is crucial for producing reliable software. As an industry, we know a lot about testing, or at least about testing conventional software. The recent democratization of AI and LLMs enabled developers and software companies to easily integrate text or image generation features into their products. LLMs possess unique properties that make testing LLM-powered software quite challenging. Why is this the case, and how can we test such software properly? Testing LLM-powered software is challenging for at least three reasons: LLMs usually produce unstructured and non-deterministic output. A small change…

Effective communication is essential and life-saving in the elder care sector. It fosters vital collaboration amongst caregivers, healthcare providers, and families, ensuring everyone is on the same page to deliver the best possible results. Serenity Connect is an innovative platform designed specifically to facilitate communication among elder care providers, clients, and their families. Founded in 2019, Serenity Connect aims to revolutionize how aging service providers, older adults, and their loved ones interact through seamless, real-time, and HIPAA-compliant communication. The journey to developing this novel platform highlights the power of person-centered…

In recent years, the rise of synthetic voice technology has opened up new possibilities for a variety of voice-based applications. Whether it's creating personalized voice assistants, enhancing accessibility tools, or developing unique AI-driven experiences, the potential is vast. But how easy is it to create a custom voice AI model that runs locally on your computer, without relying on cloud services? Applio offers a powerful, open-source solution making training and using a custom voice model accessible to everyone—from developers to creative teams. Unlike cloud-based alternatives, Applio does not require an…

In recent years, large language models (LLMs) have revolutionized the way we interact with technology. From enhancing productivity to enabling creative applications, their potential is vast. How challenging is it to run a powerful LLM directly on your PC or laptop? LM Studio is a user-friendly app that allows you to easily manage and run LLMs on your computer. It offers a streamlined interface, making it accessible even for those new to machine learning. In this video tutorial, Miloš Švaňa walks users through how to choose, download, and run an…

AI Developer Tools With the rapid advancements in large language models (LLMs) over the past few years, we’ve seen a surge in AI-powered developer tools. Since code is essentially text, it’s an ideal use case for LLMs. While there are many tools available to assist with software development, let’s focus on the most impactful ones: code completion and code manipulation tools. The most well-known tool in this space is GitHub Copilot, which gained immense popularity as one of the first to hit the market. However, there are now several new…

Applications powered by large language models (LLMs) need to be more than merely functional—they need to be scalable, reliable, and capable of continuous improvement over time. To make this happen, you need tools that allow you to trace and fine-tune your app's performance to identify inefficiencies, diagnose issues, and improve response quality. This is where LangSmith comes into play: a tool built for developers working with LLMs who need insight into how their AI models behave in production environments. LangSmith can be a game changer for AI developers. LangSmith gives…

If you want to improve your product by developing new AI features built on top of large language models (LLMs), you have many options to choose from. GPT models from Open AI are often considered the go-to solution for most use cases. But the competition in this space is heating up. Other proprietary solutions such as Gemini from Google or Claude from Anthropic are catching up in terms of quality, features, and pricing. There are also many high-quality open-weight models such as Llama-3.1 from Meta or the Mistral family from…

Are you developing an application and looking to integrate large language model (LLM) features? With multiple options like GPT, Gemini, Claude, and open-source models from Hugging Face, choosing the right solution can be overwhelming. Each model offers unique strengths, from GPT's versatile text generation to Claude's detailed descriptions, and an open-source model's flexibility. Integrating LLM features can significantly enhance your application by providing capabilities such as natural language understanding, text generation, and intelligent automation. To make an informed decision, it’s essential to evaluate your application's specific needs, compare model performances,…

In this article, we are going to talk about three tools that can, at least in theory, force any local LLM to produce structured output: LM Format Enforcer, Outlines, and Guidance. After a short description of each tool, we will evaluate their performance on a few test cases ranging from book recommendations to extracting information from HTML. And the best for the end, we will show you how forcing LLMs to produce a structured output can be used to solve a very common problem in many businesses: extracting structured records from free-form text.