En

Version 1.44#

A new Sherpa Designer release: Version 1.44

  1. In the "Recording" menu, the "Computer Vision" button has been added to launch automation mode using computer vision. Sherpa Computer Vision uses a small pre-trained neural network to detect common UI controls on the screen and therefore replaces selectors in complex scenarios: Linux Desktop (when AT SPI selectors are unavailable), virtual desktops over RDP, Citrix, Basis, VNC, etc. (when Sherpa plugins cannot be installed on the remote side), and legacy systems. Sherpa CV runs on a regular computer, including without an internet connection, and does not require a GPU.

When the "Computer Vision" button is clicked, a recorder appears for recording actions in this mode. All "Computer Vision" blocks can also be added to the diagram manually using the "Computer Vision Automation" palette.

The block descriptions are listed in the table below:

No.BlockDescription
1.Performs a mouse action on an application element: left click, right click, double click, or hover. Can be used for buttons, checkboxes, input fields, list items, and menu items.
2.Holds the cursor over the selected interface element for the specified time.
3.Performs mouse scrolling by the specified amount. Can be used for vertical or horizontal scrolling.
4.Emulates keyboard input: regular text, special keys, and key combinations such as Ctrl+S.
5.Retrieves text from the selected user interface element.
6.Waits for the selected element to appear on the screen before continuing the scenario.
7.Waits for the selected element to disappear from the screen.
8.Checks whether the selected interface element is present on the screen and returns the result of the check.
9.Copies the text of the selected interface element to the clipboard.
10.Pastes text from the clipboard into the selected interface element.
11.Extracts structured data from uniform interface elements. Can be used to collect data from pages and lists.
12.Checks the state of a checkbox and, if necessary, turns it on, off, or toggles it.
13.Selects the required item in a drop-down list by the specified text.
  1. In program settings on the "Diagram" tab, the "Strict expression validation" option has been added.

To configure the option, open the "Tools" panel, then in the "Settings" menu click the "Program settings" button.

In the "Program settings" window, open the "Diagram" tab and enable "Strict expression validation".

When this option is enabled, Sherpa Designer performs enhanced validation of expressions entered in block properties. Strict validation helps find errors earlier during project setup, reduces the risk of errors when the robot runs, and helps correct project logic more quickly. The option is enabled by default. If you encounter false validation warnings in your project, you can disable it.

  1. In the "Basic blocks" palette, the "Stop robot" block has been added, allowing a running background robot to be stopped properly.
  1. New palettes and blocks for working with Sherpa AI Server have been added.

The new blocks make it possible to use the following Sherpa AI Server capabilities: send requests to models, work with chats, manage assistant runs, and use Sherpa AI Server folders and files as a knowledge base for searching and processing data.

New blocks for working with Sherpa AI Server folders and files:

  • getting, creating, modifying, and deleting folders;
  • getting the list of files and data for a specific file;
  • uploading, downloading, modifying, and deleting files;
  • downloading a file by server path;
  • reindexing a folder;
  • indexing and chunking files;
  • adding a ready-made text chunk;
  • semantic search;
  • BM25 lexical search.

These blocks help build AI-driven scenarios: send data to the model, receive structured responses, launch assistants, attach files to the message context, and search for relevant document fragments in the Sherpa AI Server knowledge base.

New blocks for model requests:

  • Chat Completions — performs a one-time request to the model and returns a response without creating a chat, message, or run.
  • Responses — sends a request through the Responses API and returns the full model response, including the final text, status, and token usage data.
  • Reranker — evaluates the relevance of documents to a search query using the built-in BGE reranker or a selected model instance.

New blocks for agent chats and runs:

  • Create chat — creates a chat for an agent-based scenario and links it to an assistant.
  • Add message to chat — adds a structured message to the selected chat.
  • Create run — creates a new run in the chat with the waiting status.
  • Run synchronously — starts processing and waits for it to finish.
  • Run asynchronously — starts processing in the background and immediately returns control to the robot.
  • Get run — gets the current run status.
  • Get chat messages — gets messages from the selected chat and the text of the assistant's latest response.
  • Get assistant messages — gets new messages from all chats of the selected assistant.
  1. A Sherpa RPA plugin update has been released for Google Chrome, Opera, Yandex Browser, and other browsers on the same platform.

In the new plugin version, support has been restored for running custom JS scripts on a web page in newer browser versions. Previously, this capability could be blocked by new browser security policies.

To run the script, use the "Run JavaScript code" block from the "Browser automation" palette. The block properties specify the browser tab, JS code, timeout, and the variable used to store the result.

For the feature to work correctly, make sure the Sherpa RPA browser plugin is updated to version 3.1.0.

  1. The Sherpa Assistant menu now includes an option to manually restart the remote debugging VNC server.
  1. In the "Exchange" palette, the error "The recipient list is not populated for the received email" in the "Reply to email" block has been fixed.
  2. Other improvements and refinements have been made across different parts of the system.