Description:
Claude is able to:
- Take screenshots of the desktop
- Identify and describe visual elements (e.g., the "Yes"/"No" buttons on the Flask app)
- Launch Firefox via the bash tool
However, the computer_use tool is not successfully triggering mouse click actions. Claude invokes the click command, but the actual GUI element is not being interacted with (e.g., clicking the Firefox icon doesn't launch the app, clicking buttons has no effect).
Expected Behavior:
Claude should:
- Successfully move the mouse to specified coordinates
- Click the target element
- Trigger the expected GUI response (e.g., button click)
Description:
Claude is able to:
However, the
computer_usetool is not successfully triggering mouse click actions. Claude invokes the click command, but the actual GUI element is not being interacted with (e.g., clicking the Firefox icon doesn't launch the app, clicking buttons has no effect).Expected Behavior:
Claude should: