| xj | b04a402 | 2021-11-25 15:01:52 +0800 | [diff] [blame] | 1 | The Kernel Address Sanitizer (KASAN) | 
 | 2 | ==================================== | 
 | 3 |  | 
 | 4 | Overview | 
 | 5 | -------- | 
 | 6 |  | 
 | 7 | KernelAddressSANitizer (KASAN) is a dynamic memory error detector designed to | 
 | 8 | find out-of-bound and use-after-free bugs. KASAN has two modes: generic KASAN | 
 | 9 | (similar to userspace ASan) and software tag-based KASAN (similar to userspace | 
 | 10 | HWASan). | 
 | 11 |  | 
 | 12 | KASAN uses compile-time instrumentation to insert validity checks before every | 
 | 13 | memory access, and therefore requires a compiler version that supports that. | 
 | 14 |  | 
 | 15 | Generic KASAN is supported in both GCC and Clang. With GCC it requires version | 
 | 16 | 4.9.2 or later for basic support and version 5.0 or later for detection of | 
 | 17 | out-of-bounds accesses for stack and global variables and for inline | 
 | 18 | instrumentation mode (see the Usage section). With Clang it requires version | 
 | 19 | 7.0.0 or later and it doesn't support detection of out-of-bounds accesses for | 
 | 20 | global variables yet. | 
 | 21 |  | 
 | 22 | Tag-based KASAN is only supported in Clang and requires version 7.0.0 or later. | 
 | 23 |  | 
 | 24 | Currently generic KASAN is supported for the x86_64, arm64, xtensa and s390 | 
 | 25 | architectures, and tag-based KASAN is supported only for arm64. | 
 | 26 |  | 
 | 27 | Usage | 
 | 28 | ----- | 
 | 29 |  | 
 | 30 | To enable KASAN configure kernel with:: | 
 | 31 |  | 
 | 32 | 	  CONFIG_KASAN = y | 
 | 33 |  | 
 | 34 | and choose between CONFIG_KASAN_GENERIC (to enable generic KASAN) and | 
 | 35 | CONFIG_KASAN_SW_TAGS (to enable software tag-based KASAN). | 
 | 36 |  | 
 | 37 | You also need to choose between CONFIG_KASAN_OUTLINE and CONFIG_KASAN_INLINE. | 
 | 38 | Outline and inline are compiler instrumentation types. The former produces | 
 | 39 | smaller binary while the latter is 1.1 - 2 times faster. | 
 | 40 |  | 
 | 41 | Both KASAN modes work with both SLUB and SLAB memory allocators. | 
 | 42 | For better bug detection and nicer reporting, enable CONFIG_STACKTRACE. | 
 | 43 |  | 
 | 44 | To disable instrumentation for specific files or directories, add a line | 
 | 45 | similar to the following to the respective kernel Makefile: | 
 | 46 |  | 
 | 47 | - For a single file (e.g. main.o):: | 
 | 48 |  | 
 | 49 |     KASAN_SANITIZE_main.o := n | 
 | 50 |  | 
 | 51 | - For all files in one directory:: | 
 | 52 |  | 
 | 53 |     KASAN_SANITIZE := n | 
 | 54 |  | 
 | 55 | Error reports | 
 | 56 | ~~~~~~~~~~~~~ | 
 | 57 |  | 
 | 58 | A typical out-of-bounds access generic KASAN report looks like this:: | 
 | 59 |  | 
 | 60 |     ================================================================== | 
 | 61 |     BUG: KASAN: slab-out-of-bounds in kmalloc_oob_right+0xa8/0xbc [test_kasan] | 
 | 62 |     Write of size 1 at addr ffff8801f44ec37b by task insmod/2760 | 
 | 63 |  | 
 | 64 |     CPU: 1 PID: 2760 Comm: insmod Not tainted 4.19.0-rc3+ #698 | 
 | 65 |     Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014 | 
 | 66 |     Call Trace: | 
 | 67 |      dump_stack+0x94/0xd8 | 
 | 68 |      print_address_description+0x73/0x280 | 
 | 69 |      kasan_report+0x144/0x187 | 
 | 70 |      __asan_report_store1_noabort+0x17/0x20 | 
 | 71 |      kmalloc_oob_right+0xa8/0xbc [test_kasan] | 
 | 72 |      kmalloc_tests_init+0x16/0x700 [test_kasan] | 
 | 73 |      do_one_initcall+0xa5/0x3ae | 
 | 74 |      do_init_module+0x1b6/0x547 | 
 | 75 |      load_module+0x75df/0x8070 | 
 | 76 |      __do_sys_init_module+0x1c6/0x200 | 
 | 77 |      __x64_sys_init_module+0x6e/0xb0 | 
 | 78 |      do_syscall_64+0x9f/0x2c0 | 
 | 79 |      entry_SYSCALL_64_after_hwframe+0x44/0xa9 | 
 | 80 |     RIP: 0033:0x7f96443109da | 
 | 81 |     RSP: 002b:00007ffcf0b51b08 EFLAGS: 00000202 ORIG_RAX: 00000000000000af | 
 | 82 |     RAX: ffffffffffffffda RBX: 000055dc3ee521a0 RCX: 00007f96443109da | 
 | 83 |     RDX: 00007f96445cff88 RSI: 0000000000057a50 RDI: 00007f9644992000 | 
 | 84 |     RBP: 000055dc3ee510b0 R08: 0000000000000003 R09: 0000000000000000 | 
 | 85 |     R10: 00007f964430cd0a R11: 0000000000000202 R12: 00007f96445cff88 | 
 | 86 |     R13: 000055dc3ee51090 R14: 0000000000000000 R15: 0000000000000000 | 
 | 87 |  | 
 | 88 |     Allocated by task 2760: | 
 | 89 |      save_stack+0x43/0xd0 | 
 | 90 |      kasan_kmalloc+0xa7/0xd0 | 
 | 91 |      kmem_cache_alloc_trace+0xe1/0x1b0 | 
 | 92 |      kmalloc_oob_right+0x56/0xbc [test_kasan] | 
 | 93 |      kmalloc_tests_init+0x16/0x700 [test_kasan] | 
 | 94 |      do_one_initcall+0xa5/0x3ae | 
 | 95 |      do_init_module+0x1b6/0x547 | 
 | 96 |      load_module+0x75df/0x8070 | 
 | 97 |      __do_sys_init_module+0x1c6/0x200 | 
 | 98 |      __x64_sys_init_module+0x6e/0xb0 | 
 | 99 |      do_syscall_64+0x9f/0x2c0 | 
 | 100 |      entry_SYSCALL_64_after_hwframe+0x44/0xa9 | 
 | 101 |  | 
 | 102 |     Freed by task 815: | 
 | 103 |      save_stack+0x43/0xd0 | 
 | 104 |      __kasan_slab_free+0x135/0x190 | 
 | 105 |      kasan_slab_free+0xe/0x10 | 
 | 106 |      kfree+0x93/0x1a0 | 
 | 107 |      umh_complete+0x6a/0xa0 | 
 | 108 |      call_usermodehelper_exec_async+0x4c3/0x640 | 
 | 109 |      ret_from_fork+0x35/0x40 | 
 | 110 |  | 
 | 111 |     The buggy address belongs to the object at ffff8801f44ec300 | 
 | 112 |      which belongs to the cache kmalloc-128 of size 128 | 
 | 113 |     The buggy address is located 123 bytes inside of | 
 | 114 |      128-byte region [ffff8801f44ec300, ffff8801f44ec380) | 
 | 115 |     The buggy address belongs to the page: | 
 | 116 |     page:ffffea0007d13b00 count:1 mapcount:0 mapping:ffff8801f7001640 index:0x0 | 
 | 117 |     flags: 0x200000000000100(slab) | 
 | 118 |     raw: 0200000000000100 ffffea0007d11dc0 0000001a0000001a ffff8801f7001640 | 
 | 119 |     raw: 0000000000000000 0000000080150015 00000001ffffffff 0000000000000000 | 
 | 120 |     page dumped because: kasan: bad access detected | 
 | 121 |  | 
 | 122 |     Memory state around the buggy address: | 
 | 123 |      ffff8801f44ec200: fc fc fc fc fc fc fc fc fb fb fb fb fb fb fb fb | 
 | 124 |      ffff8801f44ec280: fb fb fb fb fb fb fb fb fc fc fc fc fc fc fc fc | 
 | 125 |     >ffff8801f44ec300: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 03 | 
 | 126 |                                                                     ^ | 
 | 127 |      ffff8801f44ec380: fc fc fc fc fc fc fc fc fb fb fb fb fb fb fb fb | 
 | 128 |      ffff8801f44ec400: fb fb fb fb fb fb fb fb fc fc fc fc fc fc fc fc | 
 | 129 |     ================================================================== | 
 | 130 |  | 
 | 131 | The header of the report provides a short summary of what kind of bug happened | 
 | 132 | and what kind of access caused it. It's followed by a stack trace of the bad | 
 | 133 | access, a stack trace of where the accessed memory was allocated (in case bad | 
 | 134 | access happens on a slab object), and a stack trace of where the object was | 
 | 135 | freed (in case of a use-after-free bug report). Next comes a description of | 
 | 136 | the accessed slab object and information about the accessed memory page. | 
 | 137 |  | 
 | 138 | In the last section the report shows memory state around the accessed address. | 
 | 139 | Reading this part requires some understanding of how KASAN works. | 
 | 140 |  | 
 | 141 | The state of each 8 aligned bytes of memory is encoded in one shadow byte. | 
 | 142 | Those 8 bytes can be accessible, partially accessible, freed or be a redzone. | 
 | 143 | We use the following encoding for each shadow byte: 0 means that all 8 bytes | 
 | 144 | of the corresponding memory region are accessible; number N (1 <= N <= 7) means | 
 | 145 | that the first N bytes are accessible, and other (8 - N) bytes are not; | 
 | 146 | any negative value indicates that the entire 8-byte word is inaccessible. | 
 | 147 | We use different negative values to distinguish between different kinds of | 
 | 148 | inaccessible memory like redzones or freed memory (see mm/kasan/kasan.h). | 
 | 149 |  | 
 | 150 | In the report above the arrows point to the shadow byte 03, which means that | 
 | 151 | the accessed address is partially accessible. | 
 | 152 |  | 
 | 153 | For tag-based KASAN this last report section shows the memory tags around the | 
 | 154 | accessed address (see Implementation details section). | 
 | 155 |  | 
 | 156 |  | 
 | 157 | Implementation details | 
 | 158 | ---------------------- | 
 | 159 |  | 
 | 160 | Generic KASAN | 
 | 161 | ~~~~~~~~~~~~~ | 
 | 162 |  | 
 | 163 | From a high level, our approach to memory error detection is similar to that | 
 | 164 | of kmemcheck: use shadow memory to record whether each byte of memory is safe | 
 | 165 | to access, and use compile-time instrumentation to insert checks of shadow | 
 | 166 | memory on each memory access. | 
 | 167 |  | 
 | 168 | Generic KASAN dedicates 1/8th of kernel memory to its shadow memory (e.g. 16TB | 
 | 169 | to cover 128TB on x86_64) and uses direct mapping with a scale and offset to | 
 | 170 | translate a memory address to its corresponding shadow address. | 
 | 171 |  | 
 | 172 | Here is the function which translates an address to its corresponding shadow | 
 | 173 | address:: | 
 | 174 |  | 
 | 175 |     static inline void *kasan_mem_to_shadow(const void *addr) | 
 | 176 |     { | 
 | 177 | 	return ((unsigned long)addr >> KASAN_SHADOW_SCALE_SHIFT) | 
 | 178 | 		+ KASAN_SHADOW_OFFSET; | 
 | 179 |     } | 
 | 180 |  | 
 | 181 | where ``KASAN_SHADOW_SCALE_SHIFT = 3``. | 
 | 182 |  | 
 | 183 | Compile-time instrumentation is used to insert memory access checks. Compiler | 
 | 184 | inserts function calls (__asan_load*(addr), __asan_store*(addr)) before each | 
 | 185 | memory access of size 1, 2, 4, 8 or 16. These functions check whether memory | 
 | 186 | access is valid or not by checking corresponding shadow memory. | 
 | 187 |  | 
 | 188 | GCC 5.0 has possibility to perform inline instrumentation. Instead of making | 
 | 189 | function calls GCC directly inserts the code to check the shadow memory. | 
 | 190 | This option significantly enlarges kernel but it gives x1.1-x2 performance | 
 | 191 | boost over outline instrumented kernel. | 
 | 192 |  | 
 | 193 | Software tag-based KASAN | 
 | 194 | ~~~~~~~~~~~~~~~~~~~~~~~~ | 
 | 195 |  | 
 | 196 | Tag-based KASAN uses the Top Byte Ignore (TBI) feature of modern arm64 CPUs to | 
 | 197 | store a pointer tag in the top byte of kernel pointers. Like generic KASAN it | 
 | 198 | uses shadow memory to store memory tags associated with each 16-byte memory | 
 | 199 | cell (therefore it dedicates 1/16th of the kernel memory for shadow memory). | 
 | 200 |  | 
 | 201 | On each memory allocation tag-based KASAN generates a random tag, tags the | 
 | 202 | allocated memory with this tag, and embeds this tag into the returned pointer. | 
 | 203 | Software tag-based KASAN uses compile-time instrumentation to insert checks | 
 | 204 | before each memory access. These checks make sure that tag of the memory that | 
 | 205 | is being accessed is equal to tag of the pointer that is used to access this | 
 | 206 | memory. In case of a tag mismatch tag-based KASAN prints a bug report. | 
 | 207 |  | 
 | 208 | Software tag-based KASAN also has two instrumentation modes (outline, that | 
 | 209 | emits callbacks to check memory accesses; and inline, that performs the shadow | 
 | 210 | memory checks inline). With outline instrumentation mode, a bug report is | 
 | 211 | simply printed from the function that performs the access check. With inline | 
 | 212 | instrumentation a brk instruction is emitted by the compiler, and a dedicated | 
 | 213 | brk handler is used to print bug reports. | 
 | 214 |  | 
 | 215 | A potential expansion of this mode is a hardware tag-based mode, which would | 
 | 216 | use hardware memory tagging support instead of compiler instrumentation and | 
 | 217 | manual shadow memory manipulation. |