how to click on coordinates using Appium dotnet client (C#) #900

Jhingoor · 2025-01-28T07:02:30Z

Jhingoor
Jan 28, 2025

internal class Program
{
    const string WinAppURL = "http://127.0.0.1:4723";
    const string NotepadAppId = @"C:\Windows\System32\notepad.exe";
    protected static WindowsDriver session;

    public static void Main(string[] args)
    {
        var options = new AppiumOptions
        {
            App = NotepadAppId,
            AutomationName = "Windows",
            DeviceName = "WindowsPC",
            PlatformName = "Windows"
        };
        options.AddAdditionalAppiumOption("enableImageComparison", true);
        options.AddAdditionalAppiumOption("imageMatchThreshold", 0.8); // 60% similarity


        session = new WindowsDriver(new Uri(WinAppURL), options);
        session.Manage().Timeouts().ImplicitWait = TimeSpan.FromSeconds(10);

        string imagePath = "C:\\dev\\File.png";
        byte[] imageBytes = File.ReadAllBytes(imagePath);
        string base64Image = Convert.ToBase64String(imageBytes);
        string base64ImageWithPrefix = base64Image;
        Console.WriteLine("Image Matching");

        

        var key = session.FindElement(MobileBy.Image(base64ImageWithPrefix));
        int x = key.Location.X;
        int y = key.Location.Y;
        int width = key.Size.Width;
        int height = key.Size.Height;

        //key.Click();

        //var action = new Actions(session);
        //action.MoveByOffset(x, y).Click().Perform();

    }

I have this code. It creates a session and click on the File button with the command key.Click(), but my requirement is to use coordinates to click.

I tried the commands
//var action = new Actions(session);
//action.MoveByOffset(x, y).Click().Perform();
but this throws the error
Unhandled Exception: OpenQA.Selenium.WebDriverException: Currently only pen and touch pointer input source types are supported
at OpenQA.Selenium.WebDriver.UnpackAndThrowOnError(Response errorResponse, String commandToExecute)
at OpenQA.Selenium.WebDriver.d__63.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at OpenQA.Selenium.WebDriver.Execute(String driverCommandToExecute, Dictionary2 parameters) at OpenQA.Selenium.Appium.AppiumDriver.Execute(String driverCommandToExecute, Dictionary2 parameters)
at OpenQA.Selenium.WebDriver.PerformActions(IList`1 actionSequenceList)
at OpenQA.Selenium.Interactions.Actions.Perform()
at ConsoleApp1.Program.Main(String[] args) in C:\Users\spurwar\source\repos\ConsoleApp1\ConsoleApp1\Program.cs:line 58

I am using -