Free trial

Blog

This blog is intended for software system engineers, architects and managers or people generally interested in development, testing and integration of software systems. It is part of profiq’s community effort that has the objective of sharing knowledge and ideas about software system integration, testing and development. In addition to this technical content, we share updates about life at profiq.

Tags

Let’s make LLMs generate JSON!

In this article, we are going to talk about three tools that can, at least in theory, force any local LLM to produce structured output: LM Format Enforcer, Outlines, and Guidance. After a short description of each tool, we will evaluate their performance on a few test cases ranging from book recommendations to extracting information from HTML. And the best for the end, we will show you how forcing LLMs to produce a structured output can be used to solve a very common problem in many businesses: extracting structured records from free-form text.

json llm tools

It has been over a year since OpenAI introduced ChatGPT and brought the power of AI and large language models (LLMs) to the average consumer. But we could argue that introducing APIs for seamlessly integrating large language models into apps developed by companies and independent hackers all over the world can be the true game changer in the long term. Developers are having heated discussions about how we can utilize this technology to develop truly useful apps that provide real value instead of just copying what OpenAI does. We want to contribute to this discussion by showing you how we think about developing autonomous agents at profiq. But first a bit of background.

agent ai chatgpt large language models llm openai plugin

AI and AI-powered development have become incredibly hot topics in the technology industry. The potential of AI to revolutionize various fields is widely acknowledged, and while impressive, is still being developed. Researchers, developers, and organizations are actively exploring new ways to use AI. In this dynamic landscape, we at profiq are constantly seeking out and experimenting with new libraries, plugins, and tools that leverage AI. These resources aim to enhance productivity, automate repetitive tasks, and unlock new possibilities in software development. One such resource is GitHub Copilot (Copilot). Copilot is…

#copilot ai chatgpt cypress github qa system testing test automation testing

Deploying and Scaling Elixir Apps: Heroku vs Fly.io

Phoenix is a popular Elixir web framework for building scalable, high-performance web applications. If you are building a large-scale Phoenix-based application platform, then you would most likely have a DevOps person or a DevOps team to deploy it in GCP or AWS with a Kubernetes orchestration engine. If you’re developing your app on your own or within a small team of developers, however, such cloud platforms and tools are unnecessarily sophisticated and complex for your needs. In this article, we will explore and compare two platforms that make the daunting…

devops technical research

When a user has a problem or an issue, it might seem logical to stop the conversation and immediately jump in with a solution. However, this can prevent us from truly understanding the customer’s needs and getting a broader view of the issue at hand. Active listening is an important component of any job - including in the software industry. We sat down recently with Dr. Erica Noll Webb, the senior research manager at Docker, to discuss the importance of customer-centric innovation and other timely topics related to her work.…

ai podcast ux

Empowering Users with Advanced Question-Answering Systems

For a long time, we have dreamt about systems able to answer questions related to a set of text documents — a next-gen search engine. As developers, we spend a significant portion of our time reading through documentation, trying to solve a specific problem. We are not alone. People in many other fields face similar problems. Addressing this issue could save an immense amount of time. The problem of answering a question from a set of text documents has been studied for quite some time. However, only the recent improvements…

ai machine learning technical research

Innovation is at the core of Profiq's mission. Arguably, the most innovative development in technology recently is ChatGPT, developed by OpenAI. In an earlier article, we explored OpenAI’s Codex model, which we used for code generation and editing. In this follow-up article, we share our experience leveraging OpenAI’s models programmatically via its API, for creating a plugin for Jetbrains IDEs. Querying OpenAI from the IDE We’ve been using ChatGPT from the browser in various ways to aid with our daily software development and QA. When the interaction with ChatGPT involves…

ai api chatgpt openai plugin

profiq has a new CEO

Jiří Manda has taken over the reins from the previous CEO and co-founder of the company, Gábor Puhalla. Jiří has successfully built and led LinkSoft for many years. Gábor will continue to develop business opportunities at profiq in his role as VP of Business Development and has something new in the works. To learn more about Jiří and connect with him, visit his LinkedIn profile: https://www.linkedin.com/in/jirimanda/ Follow us on social media for the latest news: LinkedIn: https://www.linkedin.com/company/profiq_2 Twitter: https://twitter.com/profiqtw Facebook: https://www.facebook.com/profiq.czech/

profiq