- Posts: 24
Best Quadcopter for Machine Vision Applications
- kr0sh1
- Topic Author
- Offline
The 'application' itself would be a camera payload, mounted to the drone's undercarriage, with a variety of sensors and processors embedded inside. The payload would need the ability to control the drone via it's existing transceiver, so a well recorded protocol with an existing library is a must.
Please Log in or Create an account to join the conversation.
- Cereal_Killer
- Offline
There has already been lots of people (or more correctly corporations) that have machine vision controlling fleets of multirotors (look at the lexus commercials for one), but it's going to be WAY HARDER to have the MV (Machine Vision) on board the craft. Probably to hard (and by that I mean it will require to much HW / code for the controller to be light enough to fit on a multirotor and still fly)
What exactly is it you're trying to do? Just have a MV setup fly a quad around a specific area? That wouldnt be to hard at all (if you're into machine vision already) to setup stationary cameras that track the MR as it moves around and even control it, but to put the HW and needed FW on board is going to be an absolutely huge task, go ahead and get your walled out now and throw it at your computer screen, cause that's what it's going to end up being...
Taranis X9E | DEVO 10 | Devo U7E | Taranis Q7
What I do in real life: rivergoequestrian.com/
Please Log in or Create an account to join the conversation.
- hexfet
- Offline
- Posts: 1891
Please Log in or Create an account to join the conversation.
- kr0sh1
- Topic Author
- Offline
- Posts: 24
I definitely understand the scepticism Cereal_Killer, because prior to my training 'machine vision', to me, meant a fully-fledged computer running something C++ based like OpenCV or another similar library - very labour intensive, expensive and heavy. Thankfully, I've been fortunate enough to spend a year working on FPGA-based camera processing, which means I can do things like track pre-determined colours over distance, and closed-loop motor control/PID control without software. Essentially, I can take the input from a camera at just under 30 FPS and determine the exact direction and altitude of an object with hardware weighing just over 50 grams, not including whatever I decide to print an enclosure out of.
Hexfet, if we round up to 100 grams and 3.3 volts with a drain of about 200mA is that sounding achievable? The previous drone I picked has a camera mounted to the bottom and a separate control interface to activate it, which was going to come in handy, unfortunately it's a UDI branded model and I'm reliably told by PhracturedBlue and victzh that the protocol for it's TX is still out of reach, creating the need for a much more 'open' and supported brand and model.
Please Log in or Create an account to join the conversation.
- victzh
- Offline
- Posts: 1386
Please Log in or Create an account to join the conversation.
- kr0sh1
- Topic Author
- Offline
- Posts: 24
Please Log in or Create an account to join the conversation.
- kr0sh1
- Topic Author
- Offline
- Posts: 24
Please Log in or Create an account to join the conversation.
- hexfet
- Offline
- Posts: 1891
Please Log in or Create an account to join the conversation.
- hexfet
- Offline
- Posts: 1891
How does it feel if you fly it with 100 grams attached? Would it have the performance you need?kr0sh1 wrote: Actually, that may have been a bit of an assumption - at full throttle it pulls 178 - 183 grams, at half it pulls 100 grams.
Please Log in or Create an account to join the conversation.
- kr0sh1
- Topic Author
- Offline
- Posts: 24
Please Log in or Create an account to join the conversation.
- mwm
- Offline
This is actually similar to a project I'm just now staring on to use a microcontroller + a bunch of sensors to change the behavior of the craft, or to the stand-alone flight stabilizers that are available for helicopters and airplanes. They sit between the Rx and the actual controls and modify things.
You want an aircraft with separate Rx and flight control boards, so you can put something in between them to control the aircraft. Doing this also generally means a larger aircraft, as the RTF/BNF aircraft don't start showing this until you get up to at least 350 size aircraft.
A PNF aircraft by definition has that separation, as you should just have to install the Rx and then fly it. For an (A)RTF/BNF aircraft, I'd check the Blade 350QX3 and the DJI Phantom's. Again, the crucial point is that the Rx and the flight control board are discrete units that you could swap out for some other vendors hardware. I haven't had much flight time on the V3 firmware, but the DJI was the more stable of the two, while the 350QX had more performance.
Since the quad flight controller has to have a microconroller on it (you can't fly a quad except "by wire"), using something that's open source firmware, if not hardware, open's the possibility of modifying the firmware so your sensor gear can communicate with it, instead of having to tweak the signals between the Rx & FC. You might find a PNP kit (i.e. - you just need to plug, and possibly bolt, the parts together to be ready to fly) with one of these as well. Since they are usually frame+electronics, mounting more hardware on them should be straight forward. The HK SK450 has gotten good reviews, and the KK2.1 FC is open source. And it will have plenty of lifting power.
If you have no flight experience, you might try buying an inexpensive RTF quad to practice on. The Syma X5C comes highly recommended for this purpose.
Do not ask me questions via PM. Ask in the forums, where I'll answer if I can.
My remotely piloted vehicle ("drone") is a yacht.
Please Log in or Create an account to join the conversation.
- kr0sh1
- Topic Author
- Offline
- Posts: 24
I looked at the KK2.1.5, have you used it before? I only went with the Naze32 because it's ARM-based and therefore a little more familiar.
Please Log in or Create an account to join the conversation.
- hexfet
- Offline
- Posts: 1891
Please Log in or Create an account to join the conversation.
- mwm
- Offline
The Quantum Venture, I don't know about. The ESC's are good, and MultiStar motors OK. You'll need to add an Rx as well as the FC. Given where we are, I assume you're going to use a deviationTx Tx.
Note that FPV and aerial photography have radically different requirements. FPV (and flight videos) use a fixed camera pointed forward, and often upward. Many of them started life as CCD security cameras with small boards. Aerial photography wants a stable platform to shoot from, with a gimbal to compensate for aircraft motion and camera pointing. Not sure which you want, but it's not clear you can put a gimbal under that kit on either set of landing skids.
Do not ask me questions via PM. Ask in the forums, where I'll answer if I can.
My remotely piloted vehicle ("drone") is a yacht.
Please Log in or Create an account to join the conversation.
- kr0sh1
- Topic Author
- Offline
- Posts: 24
And mwm - a feature that encouraged me about the Naze was the gimbal servo outputs. The payload is going to be attached to a gimbal where all the collision detection and visual recognition sensors will be housed on the end of. This eliminates rotational issues, which affect the abilities of my MV design, and allows for consistent viewing angle values to be switched between by adjusting the gimbal presets.
I am really happy with it, it's STM-based so it's pretty close to home, but with the raft of useful sensors, like you say, it takes some of the weight off my payload. As I go along I'll post some images of my work as it progresses and they'll be available on my Hackaday.io page.
Please Log in or Create an account to join the conversation.
- kr0sh1
- Topic Author
- Offline
- Posts: 24
Please Log in or Create an account to join the conversation.
- SadSack
- Offline
- Posts: 317
Please Log in or Create an account to join the conversation.
- kr0sh1
- Topic Author
- Offline
- Posts: 24
Please Log in or Create an account to join the conversation.
- SadSack
- Offline
- Posts: 317
Please Log in or Create an account to join the conversation.
- SadSack
- Offline
- Posts: 317
Please Log in or Create an account to join the conversation.
- Home
- Forum
- General
- General Discussions
- Best Quadcopter for Machine Vision Applications