| lh | 9ed821d | 2023-04-07 01:36:19 -0700 | [diff] [blame] | 1 | @node I/O Overview, I/O on Streams, Pattern Matching, Top | 
|  | 2 | @c %MENU% Introduction to the I/O facilities | 
|  | 3 | @chapter Input/Output Overview | 
|  | 4 |  | 
|  | 5 | Most programs need to do either input (reading data) or output (writing | 
|  | 6 | data), or most frequently both, in order to do anything useful.  @Theglibc{} | 
|  | 7 | provides such a large selection of input and output functions | 
|  | 8 | that the hardest part is often deciding which function is most | 
|  | 9 | appropriate! | 
|  | 10 |  | 
|  | 11 | This chapter introduces concepts and terminology relating to input | 
|  | 12 | and output.  Other chapters relating to the GNU I/O facilities are: | 
|  | 13 |  | 
|  | 14 | @itemize @bullet | 
|  | 15 | @item | 
|  | 16 | @ref{I/O on Streams}, which covers the high-level functions | 
|  | 17 | that operate on streams, including formatted input and output. | 
|  | 18 |  | 
|  | 19 | @item | 
|  | 20 | @ref{Low-Level I/O}, which covers the basic I/O and control | 
|  | 21 | functions on file descriptors. | 
|  | 22 |  | 
|  | 23 | @item | 
|  | 24 | @ref{File System Interface}, which covers functions for operating on | 
|  | 25 | directories and for manipulating file attributes such as access modes | 
|  | 26 | and ownership. | 
|  | 27 |  | 
|  | 28 | @item | 
|  | 29 | @ref{Pipes and FIFOs}, which includes information on the basic interprocess | 
|  | 30 | communication facilities. | 
|  | 31 |  | 
|  | 32 | @item | 
|  | 33 | @ref{Sockets}, which covers a more complicated interprocess communication | 
|  | 34 | facility with support for networking. | 
|  | 35 |  | 
|  | 36 | @item | 
|  | 37 | @ref{Low-Level Terminal Interface}, which covers functions for changing | 
|  | 38 | how input and output to terminals or other serial devices are processed. | 
|  | 39 | @end itemize | 
|  | 40 |  | 
|  | 41 |  | 
|  | 42 | @menu | 
|  | 43 | * I/O Concepts::       Some basic information and terminology. | 
|  | 44 | * File Names::         How to refer to a file. | 
|  | 45 | @end menu | 
|  | 46 |  | 
|  | 47 | @node I/O Concepts, File Names,  , I/O Overview | 
|  | 48 | @section Input/Output Concepts | 
|  | 49 |  | 
|  | 50 | Before you can read or write the contents of a file, you must establish | 
|  | 51 | a connection or communications channel to the file.  This process is | 
|  | 52 | called @dfn{opening} the file.  You can open a file for reading, writing, | 
|  | 53 | or both. | 
|  | 54 | @cindex opening a file | 
|  | 55 |  | 
|  | 56 | The connection to an open file is represented either as a stream or as a | 
|  | 57 | file descriptor.  You pass this as an argument to the functions that do | 
|  | 58 | the actual read or write operations, to tell them which file to operate | 
|  | 59 | on.  Certain functions expect streams, and others are designed to | 
|  | 60 | operate on file descriptors. | 
|  | 61 |  | 
|  | 62 | When you have finished reading to or writing from the file, you can | 
|  | 63 | terminate the connection by @dfn{closing} the file.  Once you have | 
|  | 64 | closed a stream or file descriptor, you cannot do any more input or | 
|  | 65 | output operations on it. | 
|  | 66 |  | 
|  | 67 | @menu | 
|  | 68 | * Streams and File Descriptors::    The GNU C Library provides two ways | 
|  | 69 | to access the contents of files. | 
|  | 70 | * File Position::                   The number of bytes from the | 
|  | 71 | beginning of the file. | 
|  | 72 | @end menu | 
|  | 73 |  | 
|  | 74 | @node Streams and File Descriptors, File Position,  , I/O Concepts | 
|  | 75 | @subsection Streams and File Descriptors | 
|  | 76 |  | 
|  | 77 | When you want to do input or output to a file, you have a choice of two | 
|  | 78 | basic mechanisms for representing the connection between your program | 
|  | 79 | and the file: file descriptors and streams.  File descriptors are | 
|  | 80 | represented as objects of type @code{int}, while streams are represented | 
|  | 81 | as @code{FILE *} objects. | 
|  | 82 |  | 
|  | 83 | File descriptors provide a primitive, low-level interface to input and | 
|  | 84 | output operations.  Both file descriptors and streams can represent a | 
|  | 85 | connection to a device (such as a terminal), or a pipe or socket for | 
|  | 86 | communicating with another process, as well as a normal file.  But, if | 
|  | 87 | you want to do control operations that are specific to a particular kind | 
|  | 88 | of device, you must use a file descriptor; there are no facilities to | 
|  | 89 | use streams in this way.  You must also use file descriptors if your | 
|  | 90 | program needs to do input or output in special modes, such as | 
|  | 91 | nonblocking (or polled) input (@pxref{File Status Flags}). | 
|  | 92 |  | 
|  | 93 | Streams provide a higher-level interface, layered on top of the | 
|  | 94 | primitive file descriptor facilities.  The stream interface treats all | 
|  | 95 | kinds of files pretty much alike---the sole exception being the three | 
|  | 96 | styles of buffering that you can choose (@pxref{Stream Buffering}). | 
|  | 97 |  | 
|  | 98 | The main advantage of using the stream interface is that the set of | 
|  | 99 | functions for performing actual input and output operations (as opposed | 
|  | 100 | to control operations) on streams is much richer and more powerful than | 
|  | 101 | the corresponding facilities for file descriptors.  The file descriptor | 
|  | 102 | interface provides only simple functions for transferring blocks of | 
|  | 103 | characters, but the stream interface also provides powerful formatted | 
|  | 104 | input and output functions (@code{printf} and @code{scanf}) as well as | 
|  | 105 | functions for character- and line-oriented input and output. | 
|  | 106 | @c !!! glibc has dprintf, which lets you do printf on an fd. | 
|  | 107 |  | 
|  | 108 | Since streams are implemented in terms of file descriptors, you can | 
|  | 109 | extract the file descriptor from a stream and perform low-level | 
|  | 110 | operations directly on the file descriptor.  You can also initially open | 
|  | 111 | a connection as a file descriptor and then make a stream associated with | 
|  | 112 | that file descriptor. | 
|  | 113 |  | 
|  | 114 | In general, you should stick with using streams rather than file | 
|  | 115 | descriptors, unless there is some specific operation you want to do that | 
|  | 116 | can only be done on a file descriptor.  If you are a beginning | 
|  | 117 | programmer and aren't sure what functions to use, we suggest that you | 
|  | 118 | concentrate on the formatted input functions (@pxref{Formatted Input}) | 
|  | 119 | and formatted output functions (@pxref{Formatted Output}). | 
|  | 120 |  | 
|  | 121 | If you are concerned about portability of your programs to systems other | 
|  | 122 | than GNU, you should also be aware that file descriptors are not as | 
|  | 123 | portable as streams.  You can expect any system running @w{ISO C} to | 
|  | 124 | support streams, but @nongnusystems{} may not support file descriptors at | 
|  | 125 | all, or may only implement a subset of the GNU functions that operate on | 
|  | 126 | file descriptors.  Most of the file descriptor functions in @theglibc{} | 
|  | 127 | are included in the POSIX.1 standard, however. | 
|  | 128 |  | 
|  | 129 | @node File Position,  , Streams and File Descriptors, I/O Concepts | 
|  | 130 | @subsection File Position | 
|  | 131 |  | 
|  | 132 | One of the attributes of an open file is its @dfn{file position} that | 
|  | 133 | keeps track of where in the file the next character is to be read or | 
|  | 134 | written.  On @gnusystems{}, and all POSIX.1 systems, the file position | 
|  | 135 | is simply an integer representing the number of bytes from the beginning | 
|  | 136 | of the file. | 
|  | 137 |  | 
|  | 138 | The file position is normally set to the beginning of the file when it | 
|  | 139 | is opened, and each time a character is read or written, the file | 
|  | 140 | position is incremented.  In other words, access to the file is normally | 
|  | 141 | @dfn{sequential}. | 
|  | 142 | @cindex file position | 
|  | 143 | @cindex sequential-access files | 
|  | 144 |  | 
|  | 145 | Ordinary files permit read or write operations at any position within | 
|  | 146 | the file.  Some other kinds of files may also permit this.  Files which | 
|  | 147 | do permit this are sometimes referred to as @dfn{random-access} files. | 
|  | 148 | You can change the file position using the @code{fseek} function on a | 
|  | 149 | stream (@pxref{File Positioning}) or the @code{lseek} function on a file | 
|  | 150 | descriptor (@pxref{I/O Primitives}).  If you try to change the file | 
|  | 151 | position on a file that doesn't support random access, you get the | 
|  | 152 | @code{ESPIPE} error. | 
|  | 153 | @cindex random-access files | 
|  | 154 |  | 
|  | 155 | Streams and descriptors that are opened for @dfn{append access} are | 
|  | 156 | treated specially for output: output to such files is @emph{always} | 
|  | 157 | appended sequentially to the @emph{end} of the file, regardless of the | 
|  | 158 | file position.  However, the file position is still used to control where in | 
|  | 159 | the file reading is done. | 
|  | 160 | @cindex append-access files | 
|  | 161 |  | 
|  | 162 | If you think about it, you'll realize that several programs can read a | 
|  | 163 | given file at the same time.  In order for each program to be able to | 
|  | 164 | read the file at its own pace, each program must have its own file | 
|  | 165 | pointer, which is not affected by anything the other programs do. | 
|  | 166 |  | 
|  | 167 | In fact, each opening of a file creates a separate file position. | 
|  | 168 | Thus, if you open a file twice even in the same program, you get two | 
|  | 169 | streams or descriptors with independent file positions. | 
|  | 170 |  | 
|  | 171 | By contrast, if you open a descriptor and then duplicate it to get | 
|  | 172 | another descriptor, these two descriptors share the same file position: | 
|  | 173 | changing the file position of one descriptor will affect the other. | 
|  | 174 |  | 
|  | 175 | @node File Names,  , I/O Concepts, I/O Overview | 
|  | 176 | @section File Names | 
|  | 177 |  | 
|  | 178 | In order to open a connection to a file, or to perform other operations | 
|  | 179 | such as deleting a file, you need some way to refer to the file.  Nearly | 
|  | 180 | all files have names that are strings---even files which are actually | 
|  | 181 | devices such as tape drives or terminals.  These strings are called | 
|  | 182 | @dfn{file names}.  You specify the file name to say which file you want | 
|  | 183 | to open or operate on. | 
|  | 184 |  | 
|  | 185 | This section describes the conventions for file names and how the | 
|  | 186 | operating system works with them. | 
|  | 187 | @cindex file name | 
|  | 188 |  | 
|  | 189 | @menu | 
|  | 190 | * Directories::                 Directories contain entries for files. | 
|  | 191 | * File Name Resolution::        A file name specifies how to look up a file. | 
|  | 192 | * File Name Errors::            Error conditions relating to file names. | 
|  | 193 | * File Name Portability::       File name portability and syntax issues. | 
|  | 194 | @end menu | 
|  | 195 |  | 
|  | 196 |  | 
|  | 197 | @node Directories, File Name Resolution,  , File Names | 
|  | 198 | @subsection Directories | 
|  | 199 |  | 
|  | 200 | In order to understand the syntax of file names, you need to understand | 
|  | 201 | how the file system is organized into a hierarchy of directories. | 
|  | 202 |  | 
|  | 203 | @cindex directory | 
|  | 204 | @cindex link | 
|  | 205 | @cindex directory entry | 
|  | 206 | A @dfn{directory} is a file that contains information to associate other | 
|  | 207 | files with names; these associations are called @dfn{links} or | 
|  | 208 | @dfn{directory entries}.  Sometimes, people speak of ``files in a | 
|  | 209 | directory'', but in reality, a directory only contains pointers to | 
|  | 210 | files, not the files themselves. | 
|  | 211 |  | 
|  | 212 | @cindex file name component | 
|  | 213 | The name of a file contained in a directory entry is called a @dfn{file | 
|  | 214 | name component}.  In general, a file name consists of a sequence of one | 
|  | 215 | or more such components, separated by the slash character (@samp{/}).  A | 
|  | 216 | file name which is just one component names a file with respect to its | 
|  | 217 | directory.  A file name with multiple components names a directory, and | 
|  | 218 | then a file in that directory, and so on. | 
|  | 219 |  | 
|  | 220 | Some other documents, such as the POSIX standard, use the term | 
|  | 221 | @dfn{pathname} for what we call a file name, and either @dfn{filename} | 
|  | 222 | or @dfn{pathname component} for what this manual calls a file name | 
|  | 223 | component.  We don't use this terminology because a ``path'' is | 
|  | 224 | something completely different (a list of directories to search), and we | 
|  | 225 | think that ``pathname'' used for something else will confuse users.  We | 
|  | 226 | always use ``file name'' and ``file name component'' (or sometimes just | 
|  | 227 | ``component'', where the context is obvious) in GNU documentation.  Some | 
|  | 228 | macros use the POSIX terminology in their names, such as | 
|  | 229 | @code{PATH_MAX}.  These macros are defined by the POSIX standard, so we | 
|  | 230 | cannot change their names. | 
|  | 231 |  | 
|  | 232 | You can find more detailed information about operations on directories | 
|  | 233 | in @ref{File System Interface}. | 
|  | 234 |  | 
|  | 235 | @node File Name Resolution, File Name Errors, Directories, File Names | 
|  | 236 | @subsection File Name Resolution | 
|  | 237 |  | 
|  | 238 | A file name consists of file name components separated by slash | 
|  | 239 | (@samp{/}) characters.  On the systems that @theglibc{} supports, | 
|  | 240 | multiple successive @samp{/} characters are equivalent to a single | 
|  | 241 | @samp{/} character. | 
|  | 242 |  | 
|  | 243 | @cindex file name resolution | 
|  | 244 | The process of determining what file a file name refers to is called | 
|  | 245 | @dfn{file name resolution}.  This is performed by examining the | 
|  | 246 | components that make up a file name in left-to-right order, and locating | 
|  | 247 | each successive component in the directory named by the previous | 
|  | 248 | component.  Of course, each of the files that are referenced as | 
|  | 249 | directories must actually exist, be directories instead of regular | 
|  | 250 | files, and have the appropriate permissions to be accessible by the | 
|  | 251 | process; otherwise the file name resolution fails. | 
|  | 252 |  | 
|  | 253 | @cindex root directory | 
|  | 254 | @cindex absolute file name | 
|  | 255 | If a file name begins with a @samp{/}, the first component in the file | 
|  | 256 | name is located in the @dfn{root directory} of the process (usually all | 
|  | 257 | processes on the system have the same root directory).  Such a file name | 
|  | 258 | is called an @dfn{absolute file name}. | 
|  | 259 | @c !!! xref here to chroot, if we ever document chroot. -rm | 
|  | 260 |  | 
|  | 261 | @cindex relative file name | 
|  | 262 | Otherwise, the first component in the file name is located in the | 
|  | 263 | current working directory (@pxref{Working Directory}).  This kind of | 
|  | 264 | file name is called a @dfn{relative file name}. | 
|  | 265 |  | 
|  | 266 | @cindex parent directory | 
|  | 267 | The file name components @file{.} (``dot'') and @file{..} (``dot-dot'') | 
|  | 268 | have special meanings.  Every directory has entries for these file name | 
|  | 269 | components.  The file name component @file{.} refers to the directory | 
|  | 270 | itself, while the file name component @file{..} refers to its | 
|  | 271 | @dfn{parent directory} (the directory that contains the link for the | 
|  | 272 | directory in question).  As a special case, @file{..} in the root | 
|  | 273 | directory refers to the root directory itself, since it has no parent; | 
|  | 274 | thus @file{/..} is the same as @file{/}. | 
|  | 275 |  | 
|  | 276 | Here are some examples of file names: | 
|  | 277 |  | 
|  | 278 | @table @file | 
|  | 279 | @item /a | 
|  | 280 | The file named @file{a}, in the root directory. | 
|  | 281 |  | 
|  | 282 | @item /a/b | 
|  | 283 | The file named @file{b}, in the directory named @file{a} in the root directory. | 
|  | 284 |  | 
|  | 285 | @item a | 
|  | 286 | The file named @file{a}, in the current working directory. | 
|  | 287 |  | 
|  | 288 | @item /a/./b | 
|  | 289 | This is the same as @file{/a/b}. | 
|  | 290 |  | 
|  | 291 | @item ./a | 
|  | 292 | The file named @file{a}, in the current working directory. | 
|  | 293 |  | 
|  | 294 | @item ../a | 
|  | 295 | The file named @file{a}, in the parent directory of the current working | 
|  | 296 | directory. | 
|  | 297 | @end table | 
|  | 298 |  | 
|  | 299 | @c An empty string may ``work'', but I think it's confusing to | 
|  | 300 | @c try to describe it.  It's not a useful thing for users to use--rms. | 
|  | 301 | A file name that names a directory may optionally end in a @samp{/}. | 
|  | 302 | You can specify a file name of @file{/} to refer to the root directory, | 
|  | 303 | but the empty string is not a meaningful file name.  If you want to | 
|  | 304 | refer to the current working directory, use a file name of @file{.} or | 
|  | 305 | @file{./}. | 
|  | 306 |  | 
|  | 307 | Unlike some other operating systems, @gnusystems{} don't have any | 
|  | 308 | built-in support for file types (or extensions) or file versions as part | 
|  | 309 | of its file name syntax.  Many programs and utilities use conventions | 
|  | 310 | for file names---for example, files containing C source code usually | 
|  | 311 | have names suffixed with @samp{.c}---but there is nothing in the file | 
|  | 312 | system itself that enforces this kind of convention. | 
|  | 313 |  | 
|  | 314 | @node File Name Errors, File Name Portability, File Name Resolution, File Names | 
|  | 315 | @subsection File Name Errors | 
|  | 316 |  | 
|  | 317 | @cindex file name errors | 
|  | 318 | @cindex usual file name errors | 
|  | 319 |  | 
|  | 320 | Functions that accept file name arguments usually detect these | 
|  | 321 | @code{errno} error conditions relating to the file name syntax or | 
|  | 322 | trouble finding the named file.  These errors are referred to throughout | 
|  | 323 | this manual as the @dfn{usual file name errors}. | 
|  | 324 |  | 
|  | 325 | @table @code | 
|  | 326 | @item EACCES | 
|  | 327 | The process does not have search permission for a directory component | 
|  | 328 | of the file name. | 
|  | 329 |  | 
|  | 330 | @item ENAMETOOLONG | 
|  | 331 | This error is used when either the total length of a file name is | 
|  | 332 | greater than @code{PATH_MAX}, or when an individual file name component | 
|  | 333 | has a length greater than @code{NAME_MAX}.  @xref{Limits for Files}. | 
|  | 334 |  | 
|  | 335 | On @gnuhurdsystems{}, there is no imposed limit on overall file name | 
|  | 336 | length, but some file systems may place limits on the length of a | 
|  | 337 | component. | 
|  | 338 |  | 
|  | 339 | @item ENOENT | 
|  | 340 | This error is reported when a file referenced as a directory component | 
|  | 341 | in the file name doesn't exist, or when a component is a symbolic link | 
|  | 342 | whose target file does not exist.  @xref{Symbolic Links}. | 
|  | 343 |  | 
|  | 344 | @item ENOTDIR | 
|  | 345 | A file that is referenced as a directory component in the file name | 
|  | 346 | exists, but it isn't a directory. | 
|  | 347 |  | 
|  | 348 | @item ELOOP | 
|  | 349 | Too many symbolic links were resolved while trying to look up the file | 
|  | 350 | name.  The system has an arbitrary limit on the number of symbolic links | 
|  | 351 | that may be resolved in looking up a single file name, as a primitive | 
|  | 352 | way to detect loops.  @xref{Symbolic Links}. | 
|  | 353 | @end table | 
|  | 354 |  | 
|  | 355 |  | 
|  | 356 | @node File Name Portability,  , File Name Errors, File Names | 
|  | 357 | @subsection Portability of File Names | 
|  | 358 |  | 
|  | 359 | The rules for the syntax of file names discussed in @ref{File Names}, | 
|  | 360 | are the rules normally used by @gnusystems{} and by other POSIX | 
|  | 361 | systems.  However, other operating systems may use other conventions. | 
|  | 362 |  | 
|  | 363 | There are two reasons why it can be important for you to be aware of | 
|  | 364 | file name portability issues: | 
|  | 365 |  | 
|  | 366 | @itemize @bullet | 
|  | 367 | @item | 
|  | 368 | If your program makes assumptions about file name syntax, or contains | 
|  | 369 | embedded literal file name strings, it is more difficult to get it to | 
|  | 370 | run under other operating systems that use different syntax conventions. | 
|  | 371 |  | 
|  | 372 | @item | 
|  | 373 | Even if you are not concerned about running your program on machines | 
|  | 374 | that run other operating systems, it may still be possible to access | 
|  | 375 | files that use different naming conventions.  For example, you may be | 
|  | 376 | able to access file systems on another computer running a different | 
|  | 377 | operating system over a network, or read and write disks in formats used | 
|  | 378 | by other operating systems. | 
|  | 379 | @end itemize | 
|  | 380 |  | 
|  | 381 | The @w{ISO C} standard says very little about file name syntax, only that | 
|  | 382 | file names are strings.  In addition to varying restrictions on the | 
|  | 383 | length of file names and what characters can validly appear in a file | 
|  | 384 | name, different operating systems use different conventions and syntax | 
|  | 385 | for concepts such as structured directories and file types or | 
|  | 386 | extensions.  Some concepts such as file versions might be supported in | 
|  | 387 | some operating systems and not by others. | 
|  | 388 |  | 
|  | 389 | The POSIX.1 standard allows implementations to put additional | 
|  | 390 | restrictions on file name syntax, concerning what characters are | 
|  | 391 | permitted in file names and on the length of file name and file name | 
|  | 392 | component strings.  However, on @gnusystems{}, any character except | 
|  | 393 | the null character is permitted in a file name string, and | 
|  | 394 | on @gnuhurdsystems{} there are no limits on the length of file name | 
|  | 395 | strings. |