\chapter{Background} Since this work builds on C, it is necessary to explain the C mechanisms and their shortcomings for array, linked list, and string, \section{Array} When a programmer works with an array, C semantics provide access to a type that is different in every way from ``pointer to its first element.'' Its qualities become apparent by inspecting the declaration \lstinput{34-34}{bkgd-carray-arrty.c} The inspection begins by using @sizeof@ to provide definite program semantics for the intuition of an expression's type. Assuming a target platform keeps things concrete: \lstinput{35-36}{bkgd-carray-arrty.c} Consider the sizes of expressions derived from @a@, modified by adding ``pointer to'' and ``first element'' (and including unnecessary parentheses to avoid confusion about precedence). \lstinput{37-40}{bkgd-carray-arrty.c} That @a@ takes up 40 bytes is common reasoning for C programmers. Set aside for a moment the claim that this first assertion is giving information about a type. For now, note that an array and a pointer to its first element are, sometimes, different things. The idea that there is such a thing as a pointer to an array may be surprising. It is not the same thing as a pointer to the first element: \lstinput{42-45}{bkgd-carray-arrty.c} The first gets \begin{cfa} warning: assignment to `float (*)[10]' from incompatible pointer type `float *' \end{cfa} and the second gets the opposite. We now refute a concern that @sizeof(a)@ is reporting on special knowledge from @a@ being an local variable, say that it is informing about an allocation, rather than simply a type. First, recognizing that @sizeof@ has two forms, one operating on an expression, the other on a type, we observe that the original answers are unaffected by using the type-parameterized form: \lstinput{46-50}{bkgd-carray-arrty.c} Finally, the same sizing is reported when there is no allocation at all, and we launch the analysis instead from the pointer-to-array type. \lstinput{51-57}{bkgd-carray-arrty.c} So, in spite of considerable programmer success enabled by an understanding that an array just a pointer to its first element (revisited TODO pointer decay), this understanding is simplistic. A shortened form for declaring local variables exists, provided that length information is given in the initializer: \lstinput{59-63}{bkgd-carray-arrty.c} In these declarations, the resulting types are both arrays, but their lengths are inferred. \begin{tabular}{lllllll} @float x;@ & $\rightarrow$ & (base element) & @float@ & @float x;@ & @[ float ]@ & @[ float ]@ \\ @float * x;@ & $\rightarrow$ & pointer & @float *@ & @float * x;@ & @[ * float ]@ & @[ * float ]@ \\ @float x[10];@ & $\rightarrow$ & array & @float[10]@ & @float x[10];@ & @[ [10] float ]@ & @[ array(float, 10) ]@ \\ @float *x[10];@ & $\rightarrow$ & array of pointers & @(float*)[10]@ & @float *x[10];@ & @[ [10] * float ]@ & @[ array(*float, 10) ]@ \\ @float (*x)[10];@ & $\rightarrow$ & pointer to array & @float(*)[10]@ & @float (*x)[10];@ & @[ * [10] float ]@ & @[ * array(float, 10) ]@ \\ @float *(*x5)[10];@ & $\rightarrow$ & pointer to array & @(float*)(*)[10]@ & @float *(*x)[10];@ & @[ * [10] * float ]@ & @[ * array(*float, 10) ]@ \end{tabular} \begin{cfa} x5 = (float*(*)[10]) x4; // x5 = (float(*)[10]) x4; // wrong target type; meta test suggesting above cast uses correct type // [here] // const // [later] // static // star as dimension // under pointer decay: int p1[const 3] being int const *p1 const float * y1; float const * y2; float * const y3; y1 = 0; y2 = 0; // y3 = 0; // bad // *y1 = 3.14; // bad // *y2 = 3.14; // bad *y3 = 3.14; const float z1 = 1.414; float const z2 = 1.414; // z1 = 3.14; // bad // z2 = 3.14; // bad } #define T float void stx2() { const T x[10]; // x[5] = 3.14; // bad } void stx3() { T const x[10]; // x[5] = 3.14; // bad } \end{cfa} My contribution is enabled by recognizing \begin{itemize} \item There is value in using a type that knows how big the whole thing is. \item The type pointer to (first) element does not. \item C \emph{has} a type that knows the whole picture: array, e.g. @T[10]@. \item This type has all the usual derived forms, which also know the whole picture. A usefully noteworthy example is pointer to array, e.g. @T(*)[10]@. \end{itemize} Each of these sections, which introduces another layer of of the C arrays' story, concludes with an \emph{Unfortunate Syntactic Reference}. It shows how to spell the types under discussion, along with interactions with orthogonal (but easily confused) language features. Alterrnate spellings are listed withing a row. The simplest occurrences of types distinguished in the preceding discussion are marked with $\triangleright$. The Type column gives the spelling used in a cast or error message (though note Section TODO points out that some types cannot be casted to). The Declaration column gives the spelling used in an object declaration, such as variable or aggregate member; parameter declarations (section TODO) follow entirely different rules. After all, reading a C array type is easy: just read it from the inside out, and know when to look left and when to look right! \CFA-specific spellings (not yet introduced) are also included here for referenceability; these can be skipped on linear reading. The \CFA-C column gives the, more fortunate, ``new'' syntax of section TODO, for spelling \emph{exactly the same type}. This fortunate syntax does not have different spellings for types vs declarations; a declaration is always the type followed by the declared identifier name; for the example of letting @x@ be a \emph{pointer to array}, the declaration is spelled: \begin{cfa} [ * [10] T ] x; \end{cfa} The \CFA-Full column gives the spelling of a different type, introduced in TODO, which has all of my contributed improvements for safety and ergonomics. \noindent \textbf{Unfortunate Syntactic Reference} \begin{figure} \centering \setlength{\tabcolsep}{3pt} \begin{tabular}{llllll} & Description & Type & Declaration & \CFA-C & \CFA-Full \\ \hline $\triangleright$ & val. & @T@ & @T x;@ & @[ T ]@ & \\ \hline & \pbox{20cm}{ \vspace{2pt} val.\\ \footnotesize{no writing the val.\ in \lstinline{x}} }\vspace{2pt} & \pbox{20cm}{ \vspace{2pt} \lstinline{const T} \\ \lstinline{T const} } & \pbox{20cm}{ \vspace{2pt} \lstinline{const T x;} \\ \lstinline{T const x;} } & @[ const T ]@ & \\ \hline \hline $\triangleright$ & ptr.\ to val. & @T *@ & @T * x;@ & @[ * T ]@ & \\ \hline & \pbox{20cm}{ \vspace{2pt} ptr.\ to val.\\ \footnotesize{no writing the ptr.\ in \lstinline{x}} }\vspace{2pt} & @T * const@ & @T * const x;@ & @[ const * T ]@ & \\ \hline & \pbox{20cm}{ \vspace{2pt} ptr.\ to val.\\ \footnotesize{no writing the val.\ in \lstinline{*x}} }\vspace{2pt} & \pbox{20cm}{ \vspace{2pt} \lstinline{const T *} \\ \lstinline{T const *} } & \pbox{20cm}{ \vspace{2pt} \lstinline{const T * x;} \\ \lstinline{T const * x;} } & @[ * const T ]@ & \\ \hline \hline $\triangleright$ & ar.\ of val. & @T[10]@ & @T x[10];@ & @[ [10] T ]@ & @[ array(T, 10) ]@ \\ \hline & \pbox{20cm}{ \vspace{2pt} ar.\ of val.\\ \footnotesize{no writing the val.\ in \lstinline{x[5]}} }\vspace{2pt} & \pbox{20cm}{ \vspace{2pt} \lstinline{const T[10]} \\ \lstinline{T const[10]} } & \pbox{20cm}{ \vspace{2pt} \lstinline{const T x[10];} \\ \lstinline{T const x[10];} } & @[ [10] const T ]@ & @[ const array(T, 10) ]@ \\ \hline & ar.\ of ptr.\ to val. & @T*[10]@ & @T *x[10];@ & @[ [10] * T ]@ & @[ array(* T, 10) ]@ \\ \hline & \pbox{20cm}{ \vspace{2pt} ar.\ of ptr.\ to val.\\ \footnotesize{no writing the ptr.\ in \lstinline{x[5]}} }\vspace{2pt} & @T * const [10]@ & @T * const x[10];@ & @[ [10] const * T ]@ & @[ array(const * T, 10) ]@ \\ \hline & \pbox{20cm}{ \vspace{2pt} ar.\ of ptr.\ to val.\\ \footnotesize{no writing the val.\ in \lstinline{*(x[5])}} }\vspace{2pt} & \pbox{20cm}{ \vspace{2pt} \lstinline{const T * [10]} \\ \lstinline{T const * [10]} } & \pbox{20cm}{ \vspace{2pt} \lstinline{const T * x[10];} \\ \lstinline{T const * x[10];} } & @[ [10] * const T ]@ & @[ array(* const T, 10) ]@ \\ \hline \hline $\triangleright$ & ptr.\ to ar.\ of val. & @T(*)[10]@ & @T (*x)[10];@ & @[ * [10] T ]@ & @[ * array(T, 10) ]@ \\ \hline & \pbox{20cm}{ \vspace{2pt} ptr.\ to ar.\ of val.\\ \footnotesize{no writing the ptr.\ in \lstinline{x}} }\vspace{2pt} & @T(* const)[10]@ & @T (* const x)[10];@ & @[ const * [10] T ]@ & @[ const * array(T, 10) ]@ \\ \hline & \pbox{20cm}{ \vspace{2pt} ptr.\ to ar.\ of val.\\ \footnotesize{no writing the val.\ in \lstinline{(*x)[5]}} }\vspace{2pt} & \pbox{20cm}{ \vspace{2pt} \lstinline{const T(*)[10]} \\ \lstinline{T const (*) [10]} } & \pbox{20cm}{ \vspace{2pt} \lstinline{const T (*x)[10];} \\ \lstinline{T const (*x)[10];} } & @[ * [10] const T ]@ & @[ * const array(T, 10) ]@ \\ \hline & ptr.\ to ar.\ of ptr.\ to val. & @T*(*)[10]@ & @T *(*x)[10];@ & @[ * [10] * T ]@ & @[ * array(* T, 10) ]@ \\ \hline \end{tabular} \caption{Figure} \end{figure} \subsection{Arrays decay and pointers diffract} The last section established the difference between these four types: \lstinput{3-6}{bkgd-carray-decay.c} But the expression used for obtaining the pointer to the first element is pedantic. The root of all C programmer experience with arrays is the shortcut \lstinput{8-8}{bkgd-carray-decay.c} which reproduces @pa0@, in type and value: \lstinput{9-9}{bkgd-carray-decay.c} The validity of this initialization is unsettling, in the context of the facts established in the last section. Notably, it initializes name @pa0x@ from expression @a@, when they are not of the same type: \lstinput{10-10}{bkgd-carray-decay.c} So, C provides an implicit conversion from @float[10]@ to @float*@, as described in ARM-6.3.2.1.3: \begin{quote} Except when it is the operand of the @sizeof@ operator, or the unary @&@ operator, or is a string literal used to initialize an array an expression that has type ``array of type'' is converted to an expression with type ``pointer to type'' that points to the initial element of the array object \end{quote} This phenomenon is the famous ``pointer decay,'' which is a decay of an array-typed expression into a pointer-typed one. It is worthy to note that the list of exception cases does not feature the occurrence of @a@ in @a[i]@. Thus, subscripting happens on pointers, not arrays. Subscripting proceeds first with pointer decay, if needed. Next, ARM-6.5.2.1.2 explains that @a[i]@ is treated as if it were @(*((a)+(i)))@. ARM-6.5.6.8 explains that the addition, of a pointer with an integer type, is defined only when the pointer refers to an element that is in an array, with a meaning of ``@i@ elements away from,'' which is valid if @a@ is big enough and @i@ is small enough. Finally, ARM-6.5.3.2.4 explains that the @*@ operator's result is the referenced element. Taken together, these rules also happen to illustrate that @a[i]@ and @i[a]@ mean the same thing. Subscripting a pointer when the target is standard-inappropriate is still practically well-defined. While the standard affords a C compiler freedom about the meaning of an out-of-bound access, or of subscripting a pointer that does not refer to an array element at all, the fact that C is famously both generally high-performance, and specifically not bound-checked, leads to an expectation that the runtime handling is uniform across legal and illegal accesses. Moreover, consider the common pattern of subscripting on a malloc result: \begin{cfa} float * fs = malloc( 10 * sizeof(float) ); fs[5] = 3.14; \end{cfa} The @malloc@ behaviour is specified as returning a pointer to ``space for an object whose size is'' as requested (ARM-7.22.3.4.2). But program says \emph{nothing} more about this pointer value, that might cause its referent to \emph{be} an array, before doing the subscript. Under this assumption, a pointer being subscripted (or added to, then dereferenced) by any value (positive, zero, or negative), gives a view of the program's entire address space, centred around the @p@ address, divided into adjacent @sizeof(*p)@ chunks, each potentially (re)interpreted as @typeof(*p)@. I call this phenomenon ``array diffraction,'' which is a diffraction of a single-element pointer into the assumption that its target is in the middle of an array whose size is unlimited in both directions. No pointer is exempt from array diffraction. No array shows its elements without pointer decay. A further pointer--array confusion, closely related to decay, occurs in parameter declarations. ARM-6.7.6.3.7 explains that when an array type is written for a parameter, the parameter's type becomes a type that I summarize as being the array-decayed type. The respective handlings of the following two parameter spellings shows that the array-spelled one is really, like the other, a pointer. \lstinput{12-16}{bkgd-carray-decay.c} As the @sizeof(x)@ meaning changed, compared with when run on a similarly-spelled local variariable declaration, GCC also gives this code the warning: ```sizeof' on array function parameter `x' will return size of `float *'.'' The caller of such a function is left with the reality that a pointer parameter is a pointer, no matter how it's spelled: \lstinput{18-21}{bkgd-carray-decay.c} This fragment gives no warnings. The shortened parameter syntax @T x[]@ is a further way to spell ``pointer.'' Note the opposite meaning of this spelling now, compared with its use in local variable declarations. This point of confusion is illustrated in: \lstinput{23-30}{bkgd-carray-decay.c} The basic two meanings, with a syntactic difference helping to distinguish, are illustrated in the declarations of @ca@ vs.\ @cp@, whose subsequent @edit@ calls behave differently. The syntax-caused confusion is in the comparison of the first and last lines, both of which use a literal to initialze an object decalared with spelling @T x[]@. But these initialized declarations get opposite meanings, depending on whether the object is a local variable or a parameter. In sumary, when a funciton is written with an array-typed parameter, \begin{itemize} \item an appearance of passing an array by value is always an incorrect understanding \item a dimension value, if any is present, is ignorred \item pointer decay is forced at the call site and the callee sees the parameter having the decayed type \end{itemize} Pointer decay does not affect pointer-to-array types, because these are already pointers, not arrays. As a result, a function with a pointer-to-array parameter sees the parameter exactly as the caller does: \lstinput{32-42}{bkgd-carray-decay.c} \noindent \textbf{Unfortunate Syntactic Reference} \noindent (Parameter declaration; ``no writing'' refers to the callee's ability) \begin{figure} \centering \begin{tabular}{llllll} & Description & Type & Param. Decl & \CFA-C \\ \hline $\triangleright$ & ptr.\ to val. & @T *@ & \pbox{20cm}{ \vspace{2pt} \lstinline{T * x,} \\ \lstinline{T x[10],} \\ \lstinline{T x[],} }\vspace{2pt} & \pbox{20cm}{ \vspace{2pt} \lstinline{[ * T ]} \\ \lstinline{[ [10] T ]} \\ \lstinline{[ [] T ]} } \\ \hline & \pbox{20cm}{ \vspace{2pt} ptr.\ to val.\\ \footnotesize{no writing the ptr.\ in \lstinline{x}} }\vspace{2pt} & @T * const@ & \pbox{20cm}{ \vspace{2pt} \lstinline{T * const x,} \\ \lstinline{T x[const 10],} \\ \lstinline{T x[const],} }\vspace{2pt} & \pbox{20cm}{ \vspace{2pt} \lstinline{[ const * T ]} \\ \lstinline{[ [const 10] T ]} \\ \lstinline{[ [const] T ]} } \\ \hline & \pbox{20cm}{ \vspace{2pt} ptr.\ to val.\\ \footnotesize{no writing the val.\ in \lstinline{*x}} }\vspace{2pt} & \pbox{20cm}{ \vspace{2pt} \lstinline{const T *} \\ \lstinline{T const *} } & \pbox{20cm}{ \vspace{2pt} \lstinline{const T * x,} \\ \lstinline{T const * x,} \\ \lstinline{const T x[10],} \\ \lstinline{T const x[10],} \\ \lstinline{const T x[],} \\ \lstinline{T const x[],} }\vspace{2pt} & \pbox{20cm}{ \vspace{2pt} \lstinline{[* const T]} \\ \lstinline{[ [10] const T ]} \\ \lstinline{[ [] const T ]} } \\ \hline \hline $\triangleright$ & ptr.\ to ar.\ of val. & @T(*)[10]@ & \pbox{20cm}{ \vspace{2pt} \lstinline{T (*x)[10],} \\ \lstinline{T x[3][10],} \\ \lstinline{T x[][10],} }\vspace{2pt} & \pbox{20cm}{ \vspace{2pt} \lstinline{[* [10] T]} \\ \lstinline{[ [3] [10] T ]} \\ \lstinline{[ [] [10] T ]} } \\ \hline & ptr.\ to ptr.\ to val. & @T **@ & \pbox{20cm}{ \vspace{2pt} \lstinline{T ** x,} \\ \lstinline{T *x[10],} \\ \lstinline{T *x[],} }\vspace{2pt} & \pbox{20cm}{ \vspace{2pt} \lstinline{[ * * T ]} \\ \lstinline{[ [10] * T ]} \\ \lstinline{[ [] * T ]} } \\ \hline & \pbox{20cm}{ \vspace{2pt} ptr.\ to ptr.\ to val.\\ \footnotesize{no writing the val.\ in \lstinline{**argv}} }\vspace{2pt} & @const char **@ & \pbox{20cm}{ \vspace{2pt} \lstinline{const char *argv[],} \\ \footnotesize{(others elided)} }\vspace{2pt} & \pbox{20cm}{ \vspace{2pt} \lstinline{[ [] * const char ]} \\ \footnotesize{(others elided)} } \\ \hline \end{tabular} \caption{Figure} \end{figure} \subsection{Lengths may vary, checking does not} When the desired number of elements is unknown at compile time, a variable-length array is a solution: \begin{cfa} int main( int argc, const char *argv[] ) { assert( argc == 2 ); size_t n = atol( argv[1] ); assert( 0 < n && n < 1000 ); float a[n]; float b[10]; // ... discussion continues here } \end{cfa} This arrangement allocates @n@ elements on the @main@ stack frame for @a@, just as it puts 10 elements on the @main@ stack frame for @b@. The variable-sized allocation of @a@ is provided by @alloca@. In a situation where the array sizes are not known to be small enough for stack allocation to be sensible, corresponding heap allocations are achievable as: \begin{cfa} float *ax1 = malloc( sizeof( float[n] ) ); float *ax2 = malloc( n * sizeof( float ) ); float *bx1 = malloc( sizeof( float[1000000] ) ); float *bx2 = malloc( 1000000 * sizeof( float ) ); \end{cfa} VLA Parameter dependency Checking is best-effort / unsound Limited special handling to get the dimension value checked (static) \subsection{C has full-service, dynamically sized, multidimensional arrays (and \CC does not)} In C and \CC, ``multidimensional array'' means ``array of arrays.'' Other meanings are discussed in TODO. Just as an array's element type can be @float@, so can it be @float[10]@. While any of @float*@, @float[10]@ and @float(*)[10]@ are easy to tell apart from @float@, telling them apart from each other may need occasional reference back to TODO intro section. The sentence derived by wrapping each type in @-[3]@ follows. While any of @float*[3]@, @float[3][10]@ and @float(*)[3][10]@ are easy to tell apart from @float[3]@, telling them apart from each other is what it takes to know what ``array of arrays'' really means. Pointer decay affects the outermost array only TODO: unfortunate syntactic reference with these cases: \begin{itemize} \item ar. of ar. of val (be sure about ordering of dimensions when the declaration is dropped) \item ptr. to ar. of ar. of val \end{itemize} \subsection{Arrays are (but) almost values} Has size; can point to Can't cast to Can't pass as value Can initialize Can wrap in aggregate Can't assign \subsection{Returning an array is (but) almost possible} \subsection{The pointer-to-array type has been noticed before} \subsection{Multi-Dimensional} As in the last section, we inspect the declaration ... \lstinput{16-18}{bkgd-carray-mdim.c} The significant axis of deriving expressions from @a@ is now ``itself,'' ``first element'' or ``first grand-element (meaning, first element of first element).'' \lstinput{20-44}{bkgd-carray-mdim.c} \section{Linked List} \section{String}