| xj | b04a402 | 2021-11-25 15:01:52 +0800 | [diff] [blame] | 1 | The Kernel Address Sanitizer (KASAN) |
| 2 | ==================================== |
| 3 | |
| 4 | Overview |
| 5 | -------- |
| 6 | |
| 7 | KernelAddressSANitizer (KASAN) is a dynamic memory error detector designed to |
| 8 | find out-of-bound and use-after-free bugs. KASAN has two modes: generic KASAN |
| 9 | (similar to userspace ASan) and software tag-based KASAN (similar to userspace |
| 10 | HWASan). |
| 11 | |
| 12 | KASAN uses compile-time instrumentation to insert validity checks before every |
| 13 | memory access, and therefore requires a compiler version that supports that. |
| 14 | |
| 15 | Generic KASAN is supported in both GCC and Clang. With GCC it requires version |
| 16 | 4.9.2 or later for basic support and version 5.0 or later for detection of |
| 17 | out-of-bounds accesses for stack and global variables and for inline |
| 18 | instrumentation mode (see the Usage section). With Clang it requires version |
| 19 | 7.0.0 or later and it doesn't support detection of out-of-bounds accesses for |
| 20 | global variables yet. |
| 21 | |
| 22 | Tag-based KASAN is only supported in Clang and requires version 7.0.0 or later. |
| 23 | |
| 24 | Currently generic KASAN is supported for the x86_64, arm64, xtensa and s390 |
| 25 | architectures, and tag-based KASAN is supported only for arm64. |
| 26 | |
| 27 | Usage |
| 28 | ----- |
| 29 | |
| 30 | To enable KASAN configure kernel with:: |
| 31 | |
| 32 | CONFIG_KASAN = y |
| 33 | |
| 34 | and choose between CONFIG_KASAN_GENERIC (to enable generic KASAN) and |
| 35 | CONFIG_KASAN_SW_TAGS (to enable software tag-based KASAN). |
| 36 | |
| 37 | You also need to choose between CONFIG_KASAN_OUTLINE and CONFIG_KASAN_INLINE. |
| 38 | Outline and inline are compiler instrumentation types. The former produces |
| 39 | smaller binary while the latter is 1.1 - 2 times faster. |
| 40 | |
| 41 | Both KASAN modes work with both SLUB and SLAB memory allocators. |
| 42 | For better bug detection and nicer reporting, enable CONFIG_STACKTRACE. |
| 43 | |
| 44 | To disable instrumentation for specific files or directories, add a line |
| 45 | similar to the following to the respective kernel Makefile: |
| 46 | |
| 47 | - For a single file (e.g. main.o):: |
| 48 | |
| 49 | KASAN_SANITIZE_main.o := n |
| 50 | |
| 51 | - For all files in one directory:: |
| 52 | |
| 53 | KASAN_SANITIZE := n |
| 54 | |
| 55 | Error reports |
| 56 | ~~~~~~~~~~~~~ |
| 57 | |
| 58 | A typical out-of-bounds access generic KASAN report looks like this:: |
| 59 | |
| 60 | ================================================================== |
| 61 | BUG: KASAN: slab-out-of-bounds in kmalloc_oob_right+0xa8/0xbc [test_kasan] |
| 62 | Write of size 1 at addr ffff8801f44ec37b by task insmod/2760 |
| 63 | |
| 64 | CPU: 1 PID: 2760 Comm: insmod Not tainted 4.19.0-rc3+ #698 |
| 65 | Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014 |
| 66 | Call Trace: |
| 67 | dump_stack+0x94/0xd8 |
| 68 | print_address_description+0x73/0x280 |
| 69 | kasan_report+0x144/0x187 |
| 70 | __asan_report_store1_noabort+0x17/0x20 |
| 71 | kmalloc_oob_right+0xa8/0xbc [test_kasan] |
| 72 | kmalloc_tests_init+0x16/0x700 [test_kasan] |
| 73 | do_one_initcall+0xa5/0x3ae |
| 74 | do_init_module+0x1b6/0x547 |
| 75 | load_module+0x75df/0x8070 |
| 76 | __do_sys_init_module+0x1c6/0x200 |
| 77 | __x64_sys_init_module+0x6e/0xb0 |
| 78 | do_syscall_64+0x9f/0x2c0 |
| 79 | entry_SYSCALL_64_after_hwframe+0x44/0xa9 |
| 80 | RIP: 0033:0x7f96443109da |
| 81 | RSP: 002b:00007ffcf0b51b08 EFLAGS: 00000202 ORIG_RAX: 00000000000000af |
| 82 | RAX: ffffffffffffffda RBX: 000055dc3ee521a0 RCX: 00007f96443109da |
| 83 | RDX: 00007f96445cff88 RSI: 0000000000057a50 RDI: 00007f9644992000 |
| 84 | RBP: 000055dc3ee510b0 R08: 0000000000000003 R09: 0000000000000000 |
| 85 | R10: 00007f964430cd0a R11: 0000000000000202 R12: 00007f96445cff88 |
| 86 | R13: 000055dc3ee51090 R14: 0000000000000000 R15: 0000000000000000 |
| 87 | |
| 88 | Allocated by task 2760: |
| 89 | save_stack+0x43/0xd0 |
| 90 | kasan_kmalloc+0xa7/0xd0 |
| 91 | kmem_cache_alloc_trace+0xe1/0x1b0 |
| 92 | kmalloc_oob_right+0x56/0xbc [test_kasan] |
| 93 | kmalloc_tests_init+0x16/0x700 [test_kasan] |
| 94 | do_one_initcall+0xa5/0x3ae |
| 95 | do_init_module+0x1b6/0x547 |
| 96 | load_module+0x75df/0x8070 |
| 97 | __do_sys_init_module+0x1c6/0x200 |
| 98 | __x64_sys_init_module+0x6e/0xb0 |
| 99 | do_syscall_64+0x9f/0x2c0 |
| 100 | entry_SYSCALL_64_after_hwframe+0x44/0xa9 |
| 101 | |
| 102 | Freed by task 815: |
| 103 | save_stack+0x43/0xd0 |
| 104 | __kasan_slab_free+0x135/0x190 |
| 105 | kasan_slab_free+0xe/0x10 |
| 106 | kfree+0x93/0x1a0 |
| 107 | umh_complete+0x6a/0xa0 |
| 108 | call_usermodehelper_exec_async+0x4c3/0x640 |
| 109 | ret_from_fork+0x35/0x40 |
| 110 | |
| 111 | The buggy address belongs to the object at ffff8801f44ec300 |
| 112 | which belongs to the cache kmalloc-128 of size 128 |
| 113 | The buggy address is located 123 bytes inside of |
| 114 | 128-byte region [ffff8801f44ec300, ffff8801f44ec380) |
| 115 | The buggy address belongs to the page: |
| 116 | page:ffffea0007d13b00 count:1 mapcount:0 mapping:ffff8801f7001640 index:0x0 |
| 117 | flags: 0x200000000000100(slab) |
| 118 | raw: 0200000000000100 ffffea0007d11dc0 0000001a0000001a ffff8801f7001640 |
| 119 | raw: 0000000000000000 0000000080150015 00000001ffffffff 0000000000000000 |
| 120 | page dumped because: kasan: bad access detected |
| 121 | |
| 122 | Memory state around the buggy address: |
| 123 | ffff8801f44ec200: fc fc fc fc fc fc fc fc fb fb fb fb fb fb fb fb |
| 124 | ffff8801f44ec280: fb fb fb fb fb fb fb fb fc fc fc fc fc fc fc fc |
| 125 | >ffff8801f44ec300: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 03 |
| 126 | ^ |
| 127 | ffff8801f44ec380: fc fc fc fc fc fc fc fc fb fb fb fb fb fb fb fb |
| 128 | ffff8801f44ec400: fb fb fb fb fb fb fb fb fc fc fc fc fc fc fc fc |
| 129 | ================================================================== |
| 130 | |
| 131 | The header of the report provides a short summary of what kind of bug happened |
| 132 | and what kind of access caused it. It's followed by a stack trace of the bad |
| 133 | access, a stack trace of where the accessed memory was allocated (in case bad |
| 134 | access happens on a slab object), and a stack trace of where the object was |
| 135 | freed (in case of a use-after-free bug report). Next comes a description of |
| 136 | the accessed slab object and information about the accessed memory page. |
| 137 | |
| 138 | In the last section the report shows memory state around the accessed address. |
| 139 | Reading this part requires some understanding of how KASAN works. |
| 140 | |
| 141 | The state of each 8 aligned bytes of memory is encoded in one shadow byte. |
| 142 | Those 8 bytes can be accessible, partially accessible, freed or be a redzone. |
| 143 | We use the following encoding for each shadow byte: 0 means that all 8 bytes |
| 144 | of the corresponding memory region are accessible; number N (1 <= N <= 7) means |
| 145 | that the first N bytes are accessible, and other (8 - N) bytes are not; |
| 146 | any negative value indicates that the entire 8-byte word is inaccessible. |
| 147 | We use different negative values to distinguish between different kinds of |
| 148 | inaccessible memory like redzones or freed memory (see mm/kasan/kasan.h). |
| 149 | |
| 150 | In the report above the arrows point to the shadow byte 03, which means that |
| 151 | the accessed address is partially accessible. |
| 152 | |
| 153 | For tag-based KASAN this last report section shows the memory tags around the |
| 154 | accessed address (see Implementation details section). |
| 155 | |
| 156 | |
| 157 | Implementation details |
| 158 | ---------------------- |
| 159 | |
| 160 | Generic KASAN |
| 161 | ~~~~~~~~~~~~~ |
| 162 | |
| 163 | From a high level, our approach to memory error detection is similar to that |
| 164 | of kmemcheck: use shadow memory to record whether each byte of memory is safe |
| 165 | to access, and use compile-time instrumentation to insert checks of shadow |
| 166 | memory on each memory access. |
| 167 | |
| 168 | Generic KASAN dedicates 1/8th of kernel memory to its shadow memory (e.g. 16TB |
| 169 | to cover 128TB on x86_64) and uses direct mapping with a scale and offset to |
| 170 | translate a memory address to its corresponding shadow address. |
| 171 | |
| 172 | Here is the function which translates an address to its corresponding shadow |
| 173 | address:: |
| 174 | |
| 175 | static inline void *kasan_mem_to_shadow(const void *addr) |
| 176 | { |
| 177 | return ((unsigned long)addr >> KASAN_SHADOW_SCALE_SHIFT) |
| 178 | + KASAN_SHADOW_OFFSET; |
| 179 | } |
| 180 | |
| 181 | where ``KASAN_SHADOW_SCALE_SHIFT = 3``. |
| 182 | |
| 183 | Compile-time instrumentation is used to insert memory access checks. Compiler |
| 184 | inserts function calls (__asan_load*(addr), __asan_store*(addr)) before each |
| 185 | memory access of size 1, 2, 4, 8 or 16. These functions check whether memory |
| 186 | access is valid or not by checking corresponding shadow memory. |
| 187 | |
| 188 | GCC 5.0 has possibility to perform inline instrumentation. Instead of making |
| 189 | function calls GCC directly inserts the code to check the shadow memory. |
| 190 | This option significantly enlarges kernel but it gives x1.1-x2 performance |
| 191 | boost over outline instrumented kernel. |
| 192 | |
| 193 | Software tag-based KASAN |
| 194 | ~~~~~~~~~~~~~~~~~~~~~~~~ |
| 195 | |
| 196 | Tag-based KASAN uses the Top Byte Ignore (TBI) feature of modern arm64 CPUs to |
| 197 | store a pointer tag in the top byte of kernel pointers. Like generic KASAN it |
| 198 | uses shadow memory to store memory tags associated with each 16-byte memory |
| 199 | cell (therefore it dedicates 1/16th of the kernel memory for shadow memory). |
| 200 | |
| 201 | On each memory allocation tag-based KASAN generates a random tag, tags the |
| 202 | allocated memory with this tag, and embeds this tag into the returned pointer. |
| 203 | Software tag-based KASAN uses compile-time instrumentation to insert checks |
| 204 | before each memory access. These checks make sure that tag of the memory that |
| 205 | is being accessed is equal to tag of the pointer that is used to access this |
| 206 | memory. In case of a tag mismatch tag-based KASAN prints a bug report. |
| 207 | |
| 208 | Software tag-based KASAN also has two instrumentation modes (outline, that |
| 209 | emits callbacks to check memory accesses; and inline, that performs the shadow |
| 210 | memory checks inline). With outline instrumentation mode, a bug report is |
| 211 | simply printed from the function that performs the access check. With inline |
| 212 | instrumentation a brk instruction is emitted by the compiler, and a dedicated |
| 213 | brk handler is used to print bug reports. |
| 214 | |
| 215 | A potential expansion of this mode is a hardware tag-based mode, which would |
| 216 | use hardware memory tagging support instead of compiler instrumentation and |
| 217 | manual shadow memory manipulation. |