ON Semiconductor

Joseph Notaro | Inka Krischke,

Depth detection in the automotive sector

Lidar can be used to determine depth and distance quickly and accurately - whether as a single point or as a 3D map of an object or a large area. But how does it work in detail?

© ON Semiconductor

The human brain is usually quite good at estimating the relative depth or distance and size of objects. This is an essential skill, especially when driving a vehicle. However, imaging systems struggle with this because standard image sensors display a 3D scene with a 2D image. The use of two image sensors in a stereoscopic arrangement, which is similar to the human eye, makes it possible to derive depth data - albeit with limitations in terms of distance accuracy and dependence on ambient brightness.

The situation is different when using lidar technology: Lidar stands for 'Light Detection and Ranging' and is a method for measuring distance. It is based on a laser and measuring the time it takes for the laser beam to be reflected back from an object. Different wavelengths can be used depending on the application, but infrared (IR) is most commonly used. Depth data provided by lidar enables measurement regardless of lighting conditions and eliminates ambiguities in an image. This allows objects within a scene to be distinguished and interpreted. By combining a light pulse that is directed at an object and reflected by it and a precise time measurement, the distance of the object can be calculated.

Advertisement

Autonomous perception

Many applications in the automotive sector lend themselves to lidar, especially in semi-autonomous vehicles operating at SAE levels L3 to L5: from detecting objects in the vehicle's surroundings to better recognition over hundreds of meters on the highway. The technology is also frequently used in delivery robots and other applications that require autonomous perception.

In outdoor applications, lidar technology can be used to create 3D depth maps quickly and with high accuracy - a process that would take days using conventional surveying techniques. In agriculture, for example, lidar is used to survey fields or areas in order to create maps and assess the condition of crops. In this way, farmers can model and predict crop yields and select the appropriate pesticides or fertilizers. The fill level of grain in silos and liquids in tanks can also be measured immediately with Lidar. The system simply needs to be attached to the top of the silo or tank without the need for contact with the contents.

Environmental organizations use lidar to assess deforestation, measure coastal erosion or monitor glacier melt. In addition, mounting lidar on unmanned aerial vehicles (UAVs) and drones enables surveying in remote, inaccessible areas.

And last but not least, smart factory operators use lidar for automated guided vehicles (AGVs) that transport raw materials for processing and finished goods to the shipping area. Lidar helps with precision tasks, for example, and alerts robots to the presence of humans to ensure work safety.

Different types of lidar and their application

  1. The principle behind the most common type of lidar, dToF (direct Time-of-Flight), is simple: the time it takes for a light pulse to travel to a target and back to the sensor is measured. As the speed of light is a known physical quantity, the distance between the transmitter/detector and the reflecting target can be easily calculated. A single short pulse is emitted from a light source (usually a laser) and a precise timer is activated at the same time. If the light pulse hits an object that is within range, it is reflected back to a highly sensitive light sensor located next to the laser. As soon as the return pulse is detected, the timer is stopped and the time taken to travel to the object and back is recorded.
    The dToF approach is fast and can measure multiple echoes, allowing multiple objects to be detected in the lidar's field of view. The technology can be used at close range and at long range (0.1 to 300 m).
  2. Another lidar approach, iToF (in-direct Time-of-Flight), uses a continuous light wave, again from a laser. Here, the elapsed time/ToF is not measured directly, but is determined from the phase difference between the transmitted and received waveform.
    iToF is more suitable for applications with a relatively short range (<10 m), especially indoors where the lighting conditions are less demanding than outdoors where the contrast is often much greater. iToF is limited to the detection of individual objects as only the strongest echo can be detected.
  3. The third type of lidar, FMCW (Frequency-Modulated Continuous Wave), is used for short and long range applications. This technique uses a tunable laser to generate a continuous wave of light that is mixed with the reflected light at the detector. This mixing creates a beat frequency between the local and reflected waveforms, which can be used to calculate the object's distance and directional velocity.
    While FMCW is capable of providing excellent distance measurement and also directional velocity information, the system costs for such a lidar system are quite high due to the tunable laser with polarization control and the short-wave infrared wavelengths required - as 'exotic' semiconductor components are needed for the laser and detector.

The debate about wavelength

One of the most controversial issues surrounding lidar is the question of wavelength. IR is preferred to visible light as it causes much less background noise and the resulting signal-to-noise ratio (SNR) is better, making it easier to detect the reflected light.

dToF measures the time it takes for the light to travel to the target and back. If the elapsed time (t) between the emitted pulse and the received echo is known, the distance (D) to the target object can be calculated using the speed of light (c).

© ON-Semiconductor

Within the IR spectrum, several wavelengths are suitable, including those of the near-infrared spectrum (NIR) at 850, 905, 940 nm and those of the short-wave infrared spectrum (SWIR) at 1350, 1550 nm. Deciding which of these spectra to use is at the heart of the 'wavelength debate'. The three most important criteria to consider are the performance of the system, the availability of suitable components and the overall cost.

One of the fundamental components in any lidar system is the detector. Silicon-based CMOS detectors detect light with wavelengths in the range of 400 to 1000 nm, which makes them sensitive to visible and NIR light - but transparent to SWIR light. To detect SWIR light, III/V semiconductors such as InGaAs alloys are required, which are very expensive compared to silicon.

Device availability is another consideration, especially for laser emitters. EELs (Edge Emitting Lasers) are now being replaced by VCSELs (Vertical Cavity Surface Emitting Lasers), which are easier to accommodate in arrays and offer a stable wavelength above temperature. VCSELs are currently still less energy-efficient and more expensive, but this will improve as they become more widespread.

There are several suppliers for SWIR-EELs, but currently only one for SWIR-VCSELs. For NIR VCSELs, on the other hand, there are several providers. Therefore, opting for NIR promises more security in the supply chain.

The detection range is also important, as it increases the available response time and therefore offers more security. However, excessively powerful lasers can damage the eyes. Therefore, the IEC 60825 standard specifies the Maximum Permissible Exposure (MPE) for a 1 ns laser pulse.

As NIR must have a lower MPE, the laser power can be increased if the pulse width is shortened. With sensitive detectors, distances of up to 300 m can be covered. In good weather, the range of SWIR exceeds that of NIR, but SWIR is more affected by moisture such as rain or fog, so the performance of an NIR-based system degrades less quickly than an SWIR-based system. This ensures more consistent performance in all weather conditions.

Comparison of lidar-based methods for depth detection.

© ON Semiconductor

For this reason, NIR is generally considered the preferred wavelength for automotive lidar, which allows the use of silicon-based devices as opposed to more expensive materials such as InGaAs. In addition, devices are available from several suppliers. While both NIR and SWIR allow for eye-safe operation, lower power lasers are used in the NIR range that still meet the lidar requirements for vehicles.
From a commercial perspective, which always plays an important role in automotive applications, NIR is significantly more cost-effective. A 2019 survey by IHS Markit found the cost of lasers and detectors to be around $4 to $20 per channel, while the cost per channel for a comparable SWIR system is around $275. Even with further development and higher volumes, the forecast is that NIR will still be between 10 and 100 times cheaper than SWIR.

Lidar components in detail

One of the most important components of a lidar system is the sensing element that detects and quantifies the reflected laser light. Several technologies are suitable for this, with SiPMs (silicon photomultipliers) offering the best performance - mainly due to their ability to detect single photons, which is due to their high gain in the order of 1,000,000. As a result, SiPMs have been increasingly used in recent years and have become the sensor of choice for lidar depth sensing applications. These devices offer the best SNR performance for long distances at high contrast - compared to conventional detectors such as avalanche photodiodes (APDs), which have a much lower gain and need to integrate the incoming signals. Additional advantages, such as lower supply bias, better homogeneity and lower sensitivity to temperature variations, make SiPMs an ideal upgrade for systems using APDs. The higher sensitivity of SiPMs also enables smaller optics, which simplifies lidar integration in vehicles. Since SiPMs are manufactured in a high-volume CMOS process, they are also cost-effective.

The author: Joseph Notaro is Vice President Worldwide Automotive Strategy and Business Development at ON Semiconductor.

© ON_Semiconductor

The RDM-0112A20-QFN array from ON Semiconductor, for example, is a monolithic 1×12 array of 0.47 mm x 1.12 mm SiPM pixels manufactured using the proprietary RDM SiPM CMOS process. This was specially developed to enable high sensitivity to NIR light. This results in a photon detection efficiency (PDE) of 18.5 % at wavelengths of 905 nm. At this wavelength, the sensitivity is greater than 100 kA/W. The high internal gain of the SiPM enables sensitivity down to the single photon range, which together with the high PDE allows detection of the weakest return signals. This results in lidar systems that can operate over long distances even with weakly reflective targets. The array is housed in a robust 10 mm x 5.2 mm QFN housing that allows access to the twelve individual pixels. It has been designed specifically for automotive lidar systems (including flash, mechanical or MEMS scanning lidar) in accordance with IATF 16949 and has AEC-Q102 approval.

  • Xing Icon
  • LinkedIn Icon
Advertisement
Advertisement

You might also be interested in

Advertisement
Advertisement
Advertisement
Advertisement
Advertisement
Advertisement
Advertisement

AMA Association

Slight decline in incoming orders

The sensor and measurement technology sector recorded no change in turnover in the third quarter of 2024 compared to the previous quarter. However, turnover fell by 10% compared to the third quarter of 2023. Incoming orders were 2% below the level...

read more...

AMA Innovation Award 2025

Submit applications now

The AMA Association for Sensors and Measurement (AMA) is calling on scientists and developers from industry and research to apply for the AMA Innovation Award 2025. We are looking for research and development results in sensor and measurement...

read more...
Subscribe to our newsletter
Advertisement
Back to home