The Rotrics computer vision kit is the official camera kit that allows you to easily implement vision applications with DexArm. Our plan for this camera kit is not only to use it for vision applications, but also use it in laser engraving to preview the engraving work. At the first stage, we plan to integrate the vision kit into the Rotrics Studio's Scratch programming function. We are working on it and it's planned to be released in early October.
Before that, it's recommended to use the Vision Terminal to deploy computer vision projects. In the Vision Terminal, we provide two demos(woodblocks recognizing and chocolate bean sorting) for you to experience the color recognizing process.
We've proudly open-sourced the project on our GitHub page. If you want to integrate the computer vision kit into your current project, feel free to download and try it out.
Welcome to share your vision projects to the community, really looking forward to your creations! For any questions, please email us at firstname.lastname@example.org.
Mac OS: coming soon
Open Rotrics Vision Terminal and connect with DexArm and camera.
Once DexArm has been connected, it will automatically move to the height preview position. You can check the camera's sight area on the TOP LEFT image. DexArm couldn't pick up the items that out of the sight area. If you couldn't see all the items in the area, please move DexArm or the items and make sure they are in the sight area.
Select the Wood Block Demo or Chocolate Bean Demo.
Choose the target color.
Adjust the HSV value until you can see the woodblocks in the TOP RIGHT result area.
Choose the color and use the DexArm panel to move DexArm to the corresponding place position.
After all color are set, click
Start to run the demo.
If you find that DexArm couldn't pick at the center of the item, try to adjust the XY Multiple values and run again.
X Multiple: the X axis's ratio between image coordinate and DexArm's cartesian coordinate. The value is different in different Z height.
Y Multiple: the Y axis's ratio between image coordinate and DexArm's cartesian coordinate. The value is different in different Z height.
Thanks for the continued support from the crowdfunding and maker community, we finally able to bring our dream to life and ship DexArm to you. Now it's time for us to pay back. We've proudly open-sourced the Rotrics Vision Terminal on GitHub. If you are interested in integrating it into your project, you can get the source code on our GitHub Page.
Before building your own vision project, please make sure you've learned to program python.
The concept of the Vision Terminal is to use a camera to recognize the items' color and shape. Here are the IDE and tools we use:
Programming Language: Python 3.6
Python IDE: Visual Studio Code
Image Process Tools: OpenCV-Python 126.96.36.199
Serial Port Communication: pySerial 3.1
Interface Construction: PyQt5
The project is built on Visual Studio Code and it's recommended to use the same platform to build it. But you can also use the other Python IDE such as PyCharm, Idle, PyDev to build it.