Defense by Carl-Johan Hoel

For: Licentiate of Engineering in Adaptive systems
Location: Lecture hall FB, Fysikgården 4, Chalmers University of Technology, Göteborg

Discussion leader: Associate Professor Christos Dimitrakakis, Department of Computer Science and Engineering, Chalmers.
Supervisors: Associate Professor Krister Wolff (Chalmers), Adjunct Professor Leo Laine (AB Volvo).
Examiner: Professor Mattias Wahde

The tactical decision-making task of an autonomous vehicle is challenging, due to the diversity of the environments the vehicle operates in, the uncertainty in the sensor information, and the complex interaction with other road users. This thesis introduces and compares three general approaches, based on reinforcement learning, to creating a tactical decision-making agent. The first method uses a genetic algorithm to automatically generate a rule based decision-making agent, whereas the second method is based on a Deep QNetwork agent. The third method combines the concepts of planning and learning, in the form of Monte Carlo tree search and deep reinforcement learning. The three approaches are applied to several highway driving cases in a simulated environment and outperform a commonly used baseline model by taking decisions that allow the vehicle to navigate 5% to 10% faster through dense traffic. However, the main advantage of the methods is their generality, which is indicated by applying them to conceptually different driving cases. Furthermore, this thesis introduces a novel way of applying a convolutional neural network architecture to a high level state description of interchangeable objects, which speeds up the learning process and eliminates all collisions in the test cases.