Ad by Google.

"How hard can it be to make an app in Android that allows all kinds of tweaks and rememebrs most per extruder ?" The (microscope) camera, connected to a Pi, is setup in Klipper as WebCam and its available on the Klipper web-page. The camera stream is also avaiable on the local network and can be displayed in a browser or picked up by an app. Moonraker has an API which can be accessed via HTTP. Well, it seems like everything is there.

The app needs some settings, see Menu Preferences:
- the ip address of the processor board used for Klipper
- the port number of Moonraker
- the webstream of the camera
- optional: logging to Android Studio LogCat and/or to a text file on the phone
- reset all tweaked parameters to their default values

Note: The app is a heavy CPU load and memory consumer. The app will drop camera frames. Within Klipper the webcam frame rate can be set, probably for internal usage in Klipper, but via the network the app still gets the full frame rate (in my case ~14 fps) of the camera.

(k)TAMV uses OpenCv, so all is based OpenCv Many parameters can be tweaked, most of them per extruder. This implies there is ample opportunity to screw image preparation and/or nozzle detection up. But don't worry, everything can be reset again.
If you don't want nozzle detection then select "None" from its menu. Per extruder the selection and preparation method can be selected manually or find them with the help of menu item "Find 1st fir" or "Find continue". "Find" peforms a 'circular' find through preparation methods and per preparation method through the detection methods, until the 1st solution with only 1 blob detection is found. When the found solution is confirmed during a number of frames the find stops. With "Find continue" the blob detection is forced to continue with the next detection method or preparation method.

       

The app's menu has:
1. Disclaimer Use the app at your own risk.
2. Find 1st fit Find the first detection which has only 1 solution (blob) from the start.
3. Find continue Continue the find with the next method.
4. View Save frame to file, Flip frame horizontal or vertical, display processed frame, tweak colors and line size.
5. Home axes Home X, Y, Z or XYZ axes.
6. Extruder Select an extruder (T0-T7), tweak some detection parameters.
7. Prepare image Select a preparation method for the nozzle detection, tweak the method parameters.
8. Nozzle detection Select a nozzle detection method and tweak its parameters (save/reset). The detection method BLOB SIMPLE is per extruder. All BLOB methods have the same parameters but different values.
9. Preferences Set Ip address, Moonraker port, webcam stream, logging or reset all parameters.
10. Privacy Policy The app does not collect and share any kind of data.
11. Exit Exit the app.

     

Before you start:
1. set all gcode offsets to zero in the Klipper configuration file
2. clean all nozzles of any filament particles
3. retract the filament, per toolhead, 2 mm so that the filament is not visible as a blob in/on the nozzle
4. make sure the microscope camera has a solid pedestal and does not move due to vibrations when the toolhead/bed moves (via the USB cable !!). I had to 3d print a pedestral, added soft rubber pads to its bottom and pin down the USB cable to the bed before it was stable.
5. home all axes before you position the camera on the build plate.
   You will have to 'lower' the buildplate before the camera will fit.
   Manually adjust the focus of the camera.
   Pin the USB cable to the build-plate to prevent very tiny movements !!!
6. select a reference extruder from which the other extruder offsets will be calculated.
   If applicable, start with the extruder which has the Z-probe attached too it.
7. Note: 'dark' nozzles are much more difficult to detect

Manual Offset determination with offsets set to zero:
1. Home the XYZ axes
2. Position the microscope camera on the build plate, the nozzle of extruder TO is visible (sharp/focussed) in the microscope picture.
3. Select from the menu "Find 1st fit"
4. If you are not satisfied with the found fit continue with "Find continue" from the menu.
5. Or select via the menu an image preparation method and nozzle detection method, and tweak them.
6. Move the extruder (T0) to the center of the display (haircross)
   Fine tune until the displayed "Bitmap XYR" values X and Y are stable.
   This means the blob center is within 1 pixel accurate.
   Note that the blob center can differ from the nozzle center.
7. Press button "SET ORIGIN".
8. Use menu "Select Extruder" to select another (T1..T7) extruder and wait for the extruder swap
9. Press button "GOTO ORIGIN".
10. Move the selected extruder (T1..T9) to the center of the display (crosshair)
11. Press button "CALCULATE OFFSET" and the X and Y offset values are displayed.

Button "GOTO ORIGIN" moves the extruder to the coordinates set with button "SET ORIGIN".
Button "GOTO OFFSET" moves the extruder to the coordinates when button "CALCULATE OFFSET" was pressed.

"FIND CENTER" offset determination with offsets set to zero:
1. Per default the reference extruder is T0 but its one of the 'other' tweak parameters.
2. Home the XYZ axes
3. Position the microscope camera on the build plate, the nozzle of extruder TO is visible (sharp/focussed) in the microscope picture.
4. Select from the menu "Find 1st fit".
5. If you are not satisfied with the found fit continue with "Find continue" from the menu.
6. Or select via the menu an image preparation method and nozzle detection method, and tweak them.
7. Move the extruder (T0) to the center of the display (haircross)
   
8. Press button "SET ORIGIN".
9. Press button "FIND CENTER". The nozzle detection is performed in 3 steps by measuring the nozzle pixel coordinates by moving the toolhead in a triangle, pentagon and heptagon pattern (including point of gravity). It stops on a direct hit in the crosshair center or when a completed measurement pattern is within the pixel accuracy. It may do some retries with the heptagon pattern.
   Note: 'find center' will restart when the difference between the measured nozzle pixel coordinates is more the 2 pixels. Changing or tweaking the preparation method and nozzle detection method can help.
10. Use menu "Select Extruder" to select another (T1..T7) extruder and wait for the extruder swap.
11. Assuming the selected extruder returns to the position of the previous extruder.
12. Press button "SET ORIGIN".
13. Press button "FIND CENTER". The nozzle detection as described above is performed again. When the center is found the offsets wrt the reference nozzle are displayed.

The origin and found centers are 'remembered per extruder' during the session so its possible to use "GOTO ORIGIN" and "GOTO CENTER" after changing extruder. They are not remembered for a 'next' session. Currently, that is ALL !

Sources/tools:
1. https://moonraker.readthedocs.io/en/latest/printer_objects/
2. https://github.com/Life0fBrian/Brians-IDEX-Nozzle-Calibration-tool
3. https://github.com/DanalEstes/TAMV
4. https://github.com/HaythamB/TAMV
5. https://github.com/TypQxQ/kTAMV
6. https://github.com/niqdev/ipcam-view
7. https://github.com/perthcpe23/android-mjpeg-view
8. https://opencv.org/android/
9. https://medium.com/@sdranju/android-studio-step-by-step-guide-for-setting-up-opencv-sdk-4-9-on-android-740547f3260b
10. https://www.codeconvert.ai/python-to-java-converter
11. https://syntha.ai/converters/python-to-java
12. https://www.deepseek.com (canny image preparation, edge_detection, matix and homography transformation)

13. Used camera: From WALLY SKY, microscope camera MGH1000, Resolution 640x480, zoom 50x-1000x

Go back to the Android App