Previous slide
Next slide

content

From ADAS to the key device – The critical role of SPAD

content

ADAS’s functions and main components

     ADAS stands for Advanced Driver Assistance Systems. Since ADAS is an “assistance system”, it is natural to know that it is somewhat different from “autopilot”. But from another perspective, the development of ADAS systems is also the only way for us to move towards the ultimate goal of autopilot.

     From the functional point of view, at present, ADAS mainly includes:

  1. Adaptive Cruise Control (ACC): This function is built on the basis of traditional cruise control. It uses Radar/LiDAR to detect the relative distance and relative speed of the vehicle ahead, and actively controls the speed of the vehicle to achieve the purpose of automatically following the vehicle. Depending on whether there is a vehicle ahead, the system can automatically switch between cruise control and cruise following.
  2. Car Navigation System: By receiving GPS (Global Positioning System) and TMC (Traffic Message Channel) signals, coupled with the geomagnetic direction sensor, gyro sensor, speed sensor installed on the car, this system can detect the movement track of the car. After the ECU calculation, the position of the vehicle can be dynamically confirmed.
  3. Lane Departure Warning System (LDWS): Use the camera installed on the front windshield to measure the road marking in front of the vehicle, and calculate the relative distance between the vehicle and the lane line, the slope and curvature of the road in real time. The system will notify the driver to immediately correct the direction when the vehicle deviates from the lane, and even actively try to guide the vehicle back to the original lane. It will reduce the probability of a car accident.
  4. Blind Spot Detection: A typical blind spot detection system uses electronic detection devices installed on both sides of the car (usually around the left and right rear mirrors or around the rear bumper) to sense through electromagnetic/radar waves/ultrasonic waves, or to capture images with cameras. When one of the sensors detects an object in the blind spot, it will warn the driver through lights, sounds or screen images to avoid rashly changing lanes and causing accidents.
  5. Front Collision Avoidance System (FCAS): The system uses camera and combining with radar detection and a special algorithm to calculate the time to collide with the vehicle in front. If the system detects that vehicle and the vehicle in front is hard to maintain an appropriate safety distance, it means there is an imminent risk of collision, the system will use the flashing light or an alarm sound to remind the driver to slow down and reduce the damage to the occupants caused by the collision accident.
  6. Pedestrian Detection: Use the stereo camera combined with the radar to detect the area ahead, and grasp the pedestrians and their movement patterns. When there may be a risk of collision, the system will issue a warning signal and a warning sound to remind the driver to respond. If there is no immediate response, more advanced systems will activate brake assist. Even if the system judges that the braking is too fast, the system will issue a command to tighten the seat belt and upright the seat back to reduce collision damage.

In addition, including: emergency braking system, automatic headlight opening and closing system, automatic parking assist system, night vision system, crosswind stabilization system, driving fatigue detection system, etc., also belong to the category of ADAS.

  From the perspective of system architecture, ADAS is mainly composed of three modules: sensor, processor and actuator.

(1) Sensor: Sensors are used to detect various external signals. For ADAS, ultrasound, Radar, LiDAR and Camera…etc. are mainly used to detect the distance. As Figure 1 below, it shows the relationship of sensors’ functions and applications.

因應ADAS不同的功能需求而採用的感測技術總覽

Figure 1 : Overview of sensing technologies used in response to different functional requirements of ADAS

(Quoted from: https://www.synopsys.com/automotive/what-is-adas.html)

(2) Processor: The function of processor is to process the incoming signal, which is usually called “Electronic Control Unit (ECU)” for cars. After receiving the signal, ECU makes appropriate classification and processing, and then outputs control signal to the actuator. Not only ECU, there are also microprocessor (MPU), digital signal processor (DSP)…etc.

(3) Actuator: According to the control signal sent by the processor, actuators control various actuated devices and let the related devices complete the actions. For example, starting the automatic brake to stop the car, displaying a warning message through the screen, starting the buzzer to make a warning sound, etc.

Applications & Technologies of LiDAR

     The full English name of LiDAR is Light Detection and Ranging. LiDAR can be applied to adaptive cruise control system, emergency braking system, pedestrian detection system and front collision warning system of advanced driver assistance system (ADAS). Its main function is precise ranging.

     LiDAR is basically composed of three parts: laser light source, light sensor and imaging mechanism. Laser light sources generally use semiconductor lasers; light sensors generally use photodiodes (PD) or avalanche photodiodes (APD); imaging mechanisms are divided into scanning or non-scanning type. The commonly used distance measurement method in automotive LiDAR is Time of Flight (ToF) technology. Regarding ToF technology, it will be explained in detail in the next chapter of this article.

     At present, the development of autopilot cars is divided into two factions according to the choice of “whether the LiDAR is adopted or not”: the first faction is the camp headed by Tesla. This camp only focuses on millimeter-wave radar and cameras, and does not use LiDAR. The second faction is headed by Google. Google not only uses millimeter-wave radar and cameras, but also uses the LiDAR of the Velodyne H64E to capture 360-degree 3D images.

     The Tesla camp decided not to use LiDAR because it was too expensive. However, judging from the actual cases accumulated by the two camps in the past ten years: Tesla’s autopilot cars have had some serious car accidents; while Google’s autopilot cars have experienced more than 3 million miles of actual tests, only more than a dozen minor incidents have occurred. In addition, from the functional point of view, LiDAR can provide 0.1-degree angular resolution, 100-meter ranging and 5~10Hz picture update rate. This has led many teams engaged in the development of autopilot cars around the world to have a general consensus, that is: according to the current level of autopilot technology, autopilot cars that do not use LiDAR as sensors have no problem reaching the standards of Level 2~3; However, to reach Level 4~5, that is, to the level of ” High Driving Automation ” or even ” Full Driving Automation “, LiDAR must be used.

blog-02-2-The rating scale of autopilot by Society of Automotive Engineers (SAE)-EN

Table 1 The rating scale of autopilot by Society of Automotive Engineers (SAE)

     LiDAR is so important for the development of autonomous driving, which also prompts the development of products towards lower cost, more durable and safer. The specific actions are as follows:

  1. Develop all-solid-state LiDAR: When a module with a rotating scanning mechanism and a drive motor needs to withstand the weather and is installed on a vehicle with frequent vibration and inertial changes, the durability of the module will be greatly challenged. Therefore, make the entire module become fully solid-state, eliminating the need for a rotating scanning mechanism and a drive motor, which can effectively improve the durability of LiDAR.
  2. Adopt the single photon avalanche diode (SPAD) as a sensor: When the bias voltage of the single-photon avalanche diode sensor exceeds the collapse area, the electrons generated by the photons are accelerated and impacted by the high electric field, and thus many electrons are generated. The electron gain produced by the cascading avalanche effect is very large. So as long as there is a single photon, an electronic signal that exceeds the threshold (threshold) can be induced. SPAD creates the advantage that the new LiDAR is very sensitive to light perception, and also allows the LiDAR module to use a lower power & lower cost laser light source.
  3. Adopt the laser light source with longer wavelength: Based on cost and power considerations, most of the laser light sources currently used in LiDAR are 905 nm lasers. However, the 905 nm band is not in the eye-safe range. Generally, the eye-safe range refers to the band greater than 1400 nm, because visible light and infrared light with wavelengths less than 1400 nm will focus on the retina, which is likely to cause permanent damage to the retina. Adopting the lasers above 1400 nm as the light source is more secure for personal health and safety.
  4. Integrate LiDAR transmitter/receiver and scanner onto the chip through semiconductor process: Integrate the laser and the sensor on the chip, which can greatly reduce the volume and reduce the weight, and meet the requirements of all-solid-state LiDAR modules. In addition, the wafer-based design makes the scanning speed more than a thousand times faster than mechanical scanning, and can greatly reduce the cost and effectively improve the cost-performance ratio of the product.

What are the differences between iToF & dToF?

  ToF is the abbreviation of Time of Flight. When we know the time of flight of light, we can calculate the distance by multiplying the speed of light by the time of flight. For example: the distance that light travels in one year is called a light-year.

     The ToF technology can be subdivided into two types: (1) iToF (Indirect Time of Flight) technology, (2) dToF (Direct Time of Flight) technology. To realize these two technologies, both a transmitter and a receiver are required, and the difference is mainly in the formula for calculating the distance.

     The transmitter of iToF technology uses modulated light with a specific period and amplitude. When the incident light of this particular modulation is reflected from the surface of the object, the receiver will receive the reflected light of the same period, but there is a phase delay between the incident light and the reflected light. When we measure this phase difference to be delayed by a few cycles, the distance can be calculated by the following formula.

    The distance calculation formula of dToF technology is more direct:

  The light source of dToF generally uses pulsed light. Pulsed light refers to a beam emitted in a very short time. The sensor of dToF records the current time when the pulsed light is emitted, and receives the reflected light. Calculate the time difference (Δt), and then directly multiply the time difference by the speed of light and divide by 2 to calculate the distance between the object and the car.

     So, what are the advantages and disadvantages of iToF and dToF? We can see from the detailed comparison in the table below. Here is a small conclusion: In the short term, iToF technology should be able to occupy a certain market share with the cost advantage of CMOS. However, with the continuous evolution of SPAD process technology, it is expected that the cost of dToF technology will be greatly improved. At that time, the advantages of dToF technology in detection distance will occupy more market shares and product applications.

blog-02-3-Comparison of advantages and disadvantages of iToF and dToF-EN

Table 2 Comparison of advantages and disadvantages of iToF and dToF

What is SPAD?

     The Single Photon Avalanche Diode (SPAD) is a semiconductor photodetector. When we apply a higher reverse bias voltage (usually 100-200 V for silicon materials) across the SPAD, after the photons enter the silicon material, we can obtain about 100 times the effect of ionization collision (avalanche breakdown). This internal current gain in turn induces a cascading multiplication effect. At this time, the current will be very large and can be easily detected by the circuit. In terms of process, through the difference of doping technology, SPAD can allow higher voltage to be applied without being broken down, so as to obtain greater gain. In general, the higher the reverse voltage, the greater the gain.

單光子雪崩二極體﹅SPAD﹅Single Photon Avalanche Photodiode﹅Avalanche Multiplication

Figure 2 Schematic diagram of the multiplication effect of single-photon avalanche diodes

  SPAD is mainly used for LiDAR and long-distance optical fiber communication, in addition, it is also beginning to be used in fields such as positron tomography and particle physics. SPAD arrays have also been commercialized, well-known manufacturers include: SONY, STMicroelectronics and ON Semiconductor…etc.

  More about SPAD characteristic testing, including bias region and current-voltage characteristics, Dark count rate (DCR), Jitter, etc., will be introduced more in the second article of this series. Coming soon!

SPAD單光子雪崩二極體