This is old material generated around 2016-2017. I’m posting here to archive the material.
The IdeasX system consists of 3 categories of devices:
Encoder – Encoders are sensor equipped devices designed to interpret any feedback an individual can provide with the disability. A few examples of feedback is limb movement, EMG, EEG, and respiration. As a device which will basically “live” with the user, encoders need to be light, portable, wireless, and have a long battery life. In addition, change is hard so encoders have to be a breeze to configure and setup.
Current development is focusing on detecting limb movement through the industry standard sensing method (gigantic switches, seriously), and a 3 axis accelerometer / 3 axis gyroscope IMU. IMU stands for inertial measurement unit. The information detected by the encoders is then processed locally and or streamed directly to the IdeasX system through Wi-Fi. Future devices may utilize lower power technology such as 802.15 or BLE.
Actuator – Actuators are devices which can be controlled by encoders. Actuators can be any device which can connect to the IdeasX system and has a list of commands for actuating that device. (Yes, you can make an encoder an actuator.)
There is quite a few actuators underdevelopment.
Workstation Client – A piece of software which allows encoders to send keystrokes, touches, and mouse clicks to any computer / smart device installed. It is specifically designed to interface with existing accessibility software. It also provides dialogs for automated pairing of encoders and actuators, lists of the active encoders in an institution / network, and dialogs for configuring encoders in the network.
iRobot – The iRobot Roomba is an amazing piece of technology which can do a lot more good than just cleaning your floors! iRobot provides a low-cost robotics platform called the Create based on the latest commercial Roomba. The Create provides access to the robot’s sensors and routines through a interface port. Undergraduate Temple students are currently designing a low-cost, plug and play kit which enables the Create to connect to the IdeasX system permitting the robot to be remotely controlled. This will provide opportunities to chair bounded students and users to interact spatially in the world.
Wi-Fi Outlet – One powerful teaching tool utilized by therapists is called the Power Link 4 which is basically an adjustable relay. The Power Link allows a binary sensor to active a wall-powered device. The Power Link can be setup to be latching, or latched for a period of time. The tool is often used to help formulate a cause and reaction relationship between the sensor and world for the user (Hey! I pressed this and this wall lamp turned on? This is cool.) Unfortunately, despite being a rather simplistic device the Power Link retails for over 200 US dollars. Luckily, for IdeasX there is already an abundance of devices which can emulate the role of the Power Link and more, are cheaper, and the only thing that stands in way is software!
Supervisor – Supervisors are devices loaded with management software for the IdeasX system. The software can exist as an app for smart devices, a web interface, or a native application of OSX, Windows and Linux. The role of software is to permit therapist to configure every aspect of the system and the devices in it.
Briefly, the purpose of the Supervisors include the following:
Listing active Encoders and Actuators in the IdeasX System
Pairing Encoders with Actuators
Storing Wi-Fi and Network parameters in Encoders and Actuators
Modification of Encoder sensitivity and Actuator functionality
Configuring Encoders for gesture recognition
Development thus far was originally a WX application for the Workstation Client. We were on a horrible deadline and the developer really worked magic to make it happen.
I’ve recently been porting this to Qt which, if I may say so myself, looks amazingly less horrible, but still a bit horrible.
This is old material I originally wrote in 2017. I’m re-posting here to archive.
IdeasX is a system developed to disrupt the current state of assistive technology for individuals with severe motor disabilities. Leveraging IoT technology and software, IdeasX aims to provide a robust method of connecting individuals via wireless sensors to a plethora of devices: from desktops running industry standard assistive software to wirelessly enabled iRobots fostering participation in gym classes.
Understanding the objectives of IdeasX requires a background of the problems similar assistive technology is attempting to solve, and the current solution set developed by industry.
The purpose of this technology is actually pretty simple: to provide an avenue for individuals with nearly zero vocal capabilities and an extremely limited range of motion to interact with world. Fundamentally, this technology is an interpreter except instead of translating languages we are translating a diminished range of motion into something a computer can understand.
This type of technology is not new and has been around for decades. Unfortunately, it is rather cost prohibitive, archaic, and clunky due to a lack of market competition. The U.S. market for assistive technology (targeted towards individuals with severe motor disabilities and/or on the autistic spectrum) is currently dominated by two entities: Don Johnston and AbleNet.
Don Johnson develops software products for computer and mobile devices specifically designed to be maneuverable with limited user input. Remember, these are individuals which do not have the ability to navigate the digital realm with a mouse and keyboard; therefore, the software has to be usable with as little input diversity as one to two keystrokes. Don Johnson only sells a single hardware product called the Switch Interface Pro 6 (I like to call it SWIP6) which retails around 100 US dollars.
The SWIP6 is basically a glorified USB keyboard with 5 jacks. The jacks connect to sensors that users can activate. When a sensor is activated the SWIP6 sends a keystroke to the computer, and if the computer is loaded with Don Johnston software, this system is enough for a decent user experience. The sensors can range from something as complex as a blink activated switch to a simple button.
AbleNet sells hardware. They produce sensors which can used with the SWIP6, and therefore Don Johnson software, but also other devices which the sensors can directly plug into and manipulate. Combined with the SWIP6, the goods they sell can do some pretty amazing things.
Here are few other products in their line up.
As you can see from the samples of AbleNet’s product line above, despite being produced for a wicked good cause, the sensors are rather ehhh…retro in their style, functionality, and pricing? $230 will give you the Jelly Beamer wireless pushbutton switch. If you would like to use the wireless switch with Don Johnson’s software, you’ll still need the SWIP6 which is another $100. You want to use this switch with a cellphone? If you have an iPhone you can purchase the switch adapter for $190. Don’t have an iPhone? Well, you’re out of luck, but they do offer a BLE capable switch for $185. AbleNet has some great ideas, but I feel their products are bit unpolished, dated, and are too rigid in functionality..
Despite my complaints (I can complain about anything), AbleNet is doing an honest job and delivering what the market expects…otherwise they wouldn’t be in business and stuff. Nevertheless, the lack of competition has stalled the market. User’s don’t know what modern technology has to offer, and current manufactures have little incentive to adjust profit margins and take the risk of funding new innovative solutions…and honestly, a lot has happened since the Jelly Beamer was developed. Technology has improved. Smart phones are now available that are infinitely more capable than the Jelly Beamer for
DISCLAIMER: Okay, I don’t actually know the amount assistive technology manufactures are making. It might be so little, that 230 USD is minimum feasible amount they can sell the good for and offer support.
The aim of IdeasX is to advance assistive technology into the 21st century through development of an open platform for connected assistive devices which can be deployed in domestic and institutional settings. Inexpensive, adaptive, multi-functional devices to populate the platform, and an inclusive attitude which will hopefully foster competition in the assistive technology market.
Wires are inconvenient for everyone. Devices developed for IdeasX will included wireless functionality as a standard and not a $100 option, but don’t worry my tin-foil-hatted-new-fangled-device-with-batteries-that-always-die-friends, the devices currently under development support encryption and will include the ability to be wired also.
IdeasX devices will connect to the IdeasX system (cough, cough cloud) through Wi-Fi. Wi-Fi is ubiquitous among computers and mobile devices. If you’re under financial strain you’re more likely to have a mobile device instead of a desktop computer. Its big to be able to do both. Supporting Wi-Fi also allows devices in the IdeasX system to connect to any device in the same network: wired or wireless. This allows us to connect to any networked computer without modifying an institution’s existing infrastructure and more importantly,any networked device can now be controlled by a student’s feedback. This is a fundamental shift.
One of my largest gripes with existing solutions is there lack of adaptability. Everything has been modularized via hardware to the point of insanity, and nothing is built to work for the user. IdeasX devices currently under development all support OTA firmware updates. This way if the therapist thinks of a new awesome way to utilize the existing hardware, we can push a software update and boom! The 1st device under development which will detect feedback from users (we call them encoders) will feature ports to be backward compatible with existing technology sold by AbleNet, but also an IMU to detect motion, tilt, and position directly.
Institutions dedicated to students with C.P. such as H.M.S. and John G. Leach school support a large number of students, and will likely have an angry storm of connected devices to manage. IdeasX will incorporate management software which can be installed on iOS, Android, Windows, and OSX. The management software will allow Therapists to configure parameters of IdeasX device’s (sensitivity, sensing method, paired device, etc) and monitor the condition of the devices (RSSI and battery life). The elimination of wires and tracking features will increase the efficiency of therapists utilizing existing wired solutions and ease the wireless storm.
IdeasX will be utilizing commercially available products whenever possible. For example, the $200+ Power Link 4 will be replaced with a $20 Wi-Fi controllable switch via a software update, and we already have plans for a kit which will convert your Roomba into mobile platform students can control.
Open and Exponential
IdeasX started though a windy road of senior design project and open source software. Keeping with it’s roots, IdeasX aims to foster technical education for students and remain an open source system.