Robotics is an enormous, poorly defined field. Ask ten different people what a robot is and you’ll likely get ten different answers. Some people might call ChatGPT a robot, since it can simulate human intelligence. Others might call a dishwasher a robot, since it has moving parts and does a task on its own. Even one of the early pioneers of robotics, Joseph Engelberg, once said "I can't define a robot, but I know one when I see one." So where does that leave us? 

For our purposes here, I will be focusing on a more traditional definition of a robot: a physical agent capable of perceiving and interacting with its environment autonomously. Think more Roomba, less chatbot. 

Following this definition, we need a robot to be able to do three things: 

  1. Interaction – it needs to have some way to actually do something in the world, either by moving around inside the world, or by directly picking up objects and manipulating them. 
  2. Perception – it needs to be able to learn something about the world around it
  3. Computation – it needs to be able to think about what to do on its own
 

In order for a robot to be useful, we want it to do all three of these. 

How a robot interacts with the world is perhaps the most intuitive. Using a variety of physical tools  – wheels, batteries, motors, arms, joints – most of us have an understanding of how different parts of a physical machine can work together to make something move. 

Where it gets trickier is, how does a robot develop a sense of the world around it? Decades of research developing more and more advanced sensors has left roboticists with an enormous arsenal of sensors at their disposal.  

Perhaps the simplest sensor a robot can have is simply a bump sensor. This sensor is essentially a giant button that, when pressed, lets the robot know that the bump sensor is in contact with something. Roombas, for example, have an enormous bump sensor in their front that is activated whenever the Roomba collides with something in its environment. This information can then be communicated to the Roomba’s computer, which then figures out how to move the Roomba. Bump sensors are excellent safety tools as well, as a robot won’t know that it needs to stop unless it knows that it has bumped into something. 

Another commonly used sensor you’ll find on robots is a camera. With the advent of neural networks in computer vision, cameras have become even more effective tools to aid robots in understanding their environment. They can be used to detect and identify different objects in their environment, as well as how far away they are. Standard cameras can see the same visual spectrum of light that human eyes can see, but we are not limited to visible light when it comes to designing cameras. We can even incorporate infrared or ultraviolet cameras capable of seeing light totally invisible to humans. Cameras are cheap, lightweight, and massively versatile, making them a perfect choice to include as a sensor for your robot. 

A robot can have sonar (Sound Navigation And Ranging), a tool for precisely measuring how far away an object is. While many people associate sonar with submarines, sonars have actually become reasonably popular as tools for land as well, with many newer cars even having a small sonar to help drivers know that an unseen obstacle might be near, or to help them park in tight situations.  

The key concept behind sonar is called the “time of flight” principle, and the mathematics behind it is reasonably simple. Imagine that Superman is flying 1000 miles per hour. It is obvious that after flying an hour, we know that Superman would have traveled 1000 miles. Similarly, if he were to fly for half an hour, we would know he traveled 500 miles.  

Now, let's say Superman flies straight from Metropolis to Gotham City, then instantaneously turns around and flies back to Metropolis(maybe he saw the bat signal and knew Bruce Wayne would take care of it). If he was flying at 1000 miles per hour, and it was 1 hour between when he left and returned to Metropolis, we know that he must have traveled 500 miles to Gotham and then 500 miles back, and thus, Gotham City is 500 miles away from Metropolis. 

This is the time of flight principle. If we know how fast something is traveling and how long it takes to get from point A to B, we can use that to calculate how far away A is from B. Sonar works the exact same way, only instead of Superman, we are measuring how fast a sound wave takes to travel and then bounce back. And since we know the speed of sound, if we make a noise while timing how long it takes for us to hear its echo, we can use the time of flight principle to calculate how far away the object was.  

One of the more complicated sensors commonly used in robotics is called LIDAR, or Light Detection And Ranging. LIDAR also uses the time of flight principle, but in a much more complex way. Firstly, instead of measuring the time of flight of sound, LIDAR uses the time of flight of laser beams to detect how far away an object is. Secondly, instead of only detecting how far away a single object is, LIDAR points lasers in every direction and in 3 dimensions. For every single point that the laser shone on, we now know the distance to that point. We can compile all of this point distance data into what is called a “point cloud,” pictured below:

Screen Shot 2024-11-25 at 11.43.31 AM

https://forums.developer.nvidia.com/t/how-to-process-and-show-a-LIDAR-point-cloud-alongside-with-rectangular-boxes-on-the-detected-objects/192021 

Hopefully, you now have some understanding of the tools robots have available to them to make sense of their environment. 

Victor holds a BS in Computer Science and Mathematics and an MS in Computer Science from UNC Chapel Hill. After working for Microsoft, he returned to academia to pursue a PhD in Computer Science (Robotics) at the University of Illinois, Urbana-Champaign.

Comments

topicTopics
academics study skills medical school admissions MCAT SAT college admissions expository writing strategy English MD/PhD admissions writing LSAT physics GMAT GRE chemistry academic advice biology graduate admissions math law school admissions ACT interview prep language learning test anxiety personal statements premed career advice MBA admissions AP exams homework help test prep creative writing MD computer science mathematics study schedules Common Application summer activities history secondary applications philosophy research organic chemistry economics supplements 1L grammar statistics & probability PSAT admissions coaching dental admissions psychology law legal studies ESL reading comprehension CARS PhD admissions SSAT covid-19 logic games calculus engineering USMLE medical school mentorship Latin Spanish parents AMCAS admissions advice biochemistry case coaching verbal reasoning DAT English literature STEM excel genetics political science skills French Linguistics MBA coursework Tutoring Approaches academic integrity astrophysics chinese classics dental school gap year letters of recommendation mechanical engineering technical interviews units Anki DO Social Advocacy algebra art history artificial intelligence business careers cell biology data science diversity statement first generation student freewriting geometry graphing kinematics linear algebra mental health presentations quantitative reasoning software engineering study abroad tech industry time management work and activities 2L AAMC DMD IB exams ISEE MD/PhD programs MMI Sentence Correction adjusting to college algorithms amino acids analysis essay argumentative writing athletics business skills cold emails executive function fellowships finance functions genomics information sessions international students internships logic networking office hours poetry pre-dental proofs resume revising scholarships science social sciences trigonometry writer's block 3L Academic Interest EMT FlexMed Fourier Series Greek Health Professional Shortage Area Italian JD/MBA admissions Japanese Lagrange multipliers London MD vs PhD Montessori National Health Service Corps Pythagorean Theorem Python Shakespeare Step 2 TMDSAS Taylor Series Truss Analysis Zoom acids and bases active learning architecture art art and design schools art portfolios bacteriology bibliographies biomedicine brain teaser burnout campus visits cantonese capacitors capital markets central limit theorem centrifugal force chem/phys chemical engineering chess chromatography class participation climate change clinical experience community service constitutional law consulting cover letters curriculum dementia demonstrated interest dimensional analysis distance learning econometrics electric engineering electricity and magnetism embryology entropy escape velocity evolution extracurriculars fundraising harmonics health policy history of medicine history of science hybrid vehicles hydrophobic effect ideal gas law immunology induction infinite institutional actions integrated reasoning intermolecular forces intern investing investment banking lab reports letter of continued interest linear maps mandarin chinese