Changeset d3a85240

Timestamp:

Jan 11, 2017, 3:30:10 PM (8 years ago)

Author:

Rob Schluntz <rschlunt@…>

Branches:

ADT, aaron-thesis, arm-eh, ast-experimental, cleanup-dtors, deferred_resn, demangler, enum, forall-pointer-decay, jacob/cs343-translation, jenkins-sandbox, master, new-ast, new-ast-unique-expr, new-env, no_list, persistent-indexer, pthread-emulation, qualifiedEnum, resolv-new, with_gc

Children:

2162c2c, 2298a7b8

Parents:

dd0c97b (diff), 17e5e2b (diff)
Note: this is a merge changeset, the changes displayed below correspond to the merge itself.
Use the (diff) links above to see all the changes relative to each parent.

Message:

Merge branch 'master' of plg.uwaterloo.ca:/u/cforall/software/cfa/cfa-cc

Files:

• doc/proposals/concurrency/concurrency.tex (modified) (6 diffs)
• doc/proposals/concurrency/cor-thread-traits.c (added)
• doc/proposals/concurrency/version (modified) (1 diff)
• src/libcfa/concurrency/threads (modified) (2 diffs)
• src/libcfa/containers/vector (modified) (2 diffs)
• src/libcfa/fstream (modified) (2 diffs)
• src/libcfa/iostream (modified) (2 diffs)
• src/libcfa/iterator (modified) (2 diffs)
• src/libcfa/limits (modified) (2 diffs)
• src/libcfa/math (modified) (2 diffs)
• src/libcfa/rational (modified) (2 diffs)
• src/libcfa/stdlib (modified) (2 diffs)

doc/proposals/concurrency/concurrency.tex

@@ -149 +149 @@
 
 \begin{lstlisting}
-        mutex struct counter_t { /*...see section §\ref{data}§...*/ };
+        mutex struct counter_t { /*...see section §\ref{data}§...*/ };
 
         void ?{}(counter_t & nomutex this); //constructor
@@ -767 +767 @@
 TO BE CONTINUED...
 
+
+
+
+
+
+
+
+
+
 \newpage
 % ######     #    ######     #    #       #       ####### #       ###  #####  #     #
@@ -807 +816 @@
 As a system-level language, \CFA should offer both performance and flexibilty as its primary goals, simplicity and user-friendliness being a secondary concern. Therefore, the core of parallelism in \CFA should prioritize power and efficiency. With this said, deconstructing popular paradigms in order to get simple building blocks yields \glspl{uthread} as the core parallelism block. \Glspl{pool} and other parallelism paradigms can then be built on top of the underlying threading model.
 
+\subsection{Coroutines : A stepping stone}\label{coroutine}
+While the main focus of this proposal is concurrency and paralellism, it is important to adress coroutines which are actually a significant underlying aspect of the concurrency system. Indeed, while having nothing todo with parallelism and arguably very little to do with concurrency, coroutines need to deal with context-switchs and and other context management operations. Therefore, this proposal includes coroutines both as an intermediate step for the implementation of threads and a first class feature of \CFA.
+
+The core API of coroutines revolve around two features : independent stacks and \code{suspend}/\code{resume}.
+Here is an example of a solution to the fibonnaci problem using \CFA coroutines :
+\begin{lstlisting}
+        struct Fibonacci {
+              int fn; // used for communication
+              coroutine_descriptor c;
+        };
+
+        void ?{}(Fibonacci* this) {
+              this->fn = 0;
+        }
+
+        coroutine_descriptor* get_¶coroutine¶(Fibonacci* this) {
+              return &this->c;
+        }
+
+        void co_main(Fibonacci* this) {
+                int fn1, fn2;           // retained between resumes
+                this->fn = 0;
+                fn1 = this->fn;
+                suspend(this);          // return to last resume
+
+                this->fn = 1;
+                fn2 = fn1;
+                fn1 = this->fn;
+                suspend(this);          // return to last resume
+
+                for ( ;; ) {
+                        this->fn = fn1 + fn2;
+                        fn2 = fn1;
+                        fn1 = this->fn;
+                        suspend(this);  // return to last resume
+                }
+        }
+
+        int next(Fibonacci* this) {
+                resume(this); // transfer to last suspend
+                return this.fn;
+        }
+
+        void main() {
+                Fibonacci f1, f2;
+                for ( int i = 1; i <= 10; i += 1 ) {
+                        sout | next(&f1) | '§\verb+ +§' | next(&f2) | endl;
+                }
+        }
+\end{lstlisting}
+
+\subsubsection{Construction}
+One important design challenge for coroutines and threads (shown in section \ref{threads}) is that the runtime system needs to run some code after the user-constructor runs. In the case of the coroutines this challenge is simpler since there is no loss of determinism brough by preemption or scheduling, however, the underlying challenge remains the same for coroutines and threads.
+
+The runtime system needs to create the coroutine's stack and more importantly prepare it for the first resumption. The timing of the creation is non trivial since users both expect to have fully constructed objects once the main is called and to be able to resume the coroutine from the main (Obviously we only solve cases where these two statements don't conflict). There are several solutions to this problem but the chosen options effectively forces the design of the coroutine.
+
+Furthermore, \CFA faces an extra challenge which is that polymorphique routines rely on invisible thunks when casted to non-polymorphic routines and these thunks have function scope, for example :
+
+TODO : Simple case where a thunk would be created.
+
+
+
+\subsubsection{Alternative: Inheritance}
+One solution to this challenge would be to use inheritence,
+
+\begin{lstlisting}
+        struct Fibonacci {
+              int fn; // used for communication
+              coroutine c;
+        };
+
+        void ?{}(Fibonacci* this) {
+              this->fn = 0;
+                (&this->c){};
+        }
+\end{lstlisting}
+
+There are two downsides to the approach. The first, which is relatively minor, is that the base class needs to be made aware of the main routine pointer, regardless of whether we use a parameter or a virtual pointer, this means the coroutine data must be made larger to store a value that is actually a compile time constant (The address of the main routine). The second problem which is both subtle but significant, is that now can get the initialisation order of there coroutines wrong. Indeed, every field of a \CFA struct will be constructed but in the order of declaration, unless users explicitly write otherwise. This means that users who forget to initialize a the coroutine at the right time may resume the coroutine at with an uninitilized object. For coroutines, this is unlikely to be a problem, for threads however, this is a significant problem.
+
+\subsubsection{Alternative: Reserved keyword}
+The next alternative is to use language support to annotate coroutines as follows :
+
+\begin{lstlisting}
+        coroutine struct Fibonacci {
+              int fn; // used for communication
+        };
+\end{lstlisting}
+
+This mean the compiler can solve problems by injecting code where needed. The downside of this approach is that it makes coroutine a special case in the language. Users who would want to extend coroutines or build their own for various reasons can only do so in ways offered by the language. Furthermore, implementing coroutines without language supports also displays the power of \CFA.
+
+\subsubsection{Alternative: Lamda Objects}
+
+Boost does not use objects...
+TO BE CONTINUED...
+
+\subsubsection{Trait based coroutines}
+
+Finally the approach chosen, which is the one closest to \CFA idioms, is to use trait-based lazy coroutines, the approach shown in section \ref{coroutine}. This approach defines a coroutine as anything that satisfies the \code{is_coroutine} and is used as a coroutine is a coroutine. This entails the an object is not a coroutine until \code{resume} (and \code{prime}) is called on the object. Correspondingly, any object that is passed to \code{resume} is a coroutine since it must satisfy the \code{is_coroutine} trait to compile.
+
 % ####### #     # ######  #######    #    ######   #####
 %    #    #     # #     # #         # #   #     # #     #
@@ -815 +923 @@
 %    #    #     # #     # ####### #     # ######   #####
 
-\subsection{Thread Interface}
+\subsection{Thread Interface}\label{threads}
 The basic building blocks of \CFA are \glspl{cfathread}. By default these are implemented as \glspl{uthread}, and as such, offer a flexible and lightweight threading interface (lightweight compared to \glspl{kthread}). A thread can be declared using a struct declaration with prefix \code{thread} as follows :
 
 \begin{lstlisting}
+        trait is_¶thread¶(dtype T) {
+                void co_main(T* this);
+                coroutine* get_coroutine(T* this);
+        };
+
         thread struct foo {};
 \end{lstlisting}
@@ -845 +958 @@
 
         //main
-        void ?main(FuncRunner* this) {
+        void t_main(FuncRunner* this) {
                 this->func();
         }
@@ -927 +1040 @@
 
                 //Wait for the 10 threads to finish
-        }
-\end{lstlisting}
-
-\subsection{Coroutines : A stepping stone}\label{coroutine}
-While the main focus of this proposal is concurrency and paralellism, it is important to adress coroutines which are actually a significant underlying aspect of the concurrency system. Indeed, while having nothing todo with parallelism and arguably very little to do with concurrency, coroutines need to deal with context-switchs and and other context management operations. Therefore, this proposal includes coroutines both as an intermediate step for the implementation of threads and a first class feature of \CFA.
-
-The core API of coroutines revolve around two features : independent stacks and suspedn/resume. Much like threads the syntax for declaring a coroutine is declaring a type and a main routine for it to start :
-\begin{lstlisting}
-        coroutine struct MyCoroutine {
-                //...
-        };
-
-        //ctor
-        void ?{}(MyCoroutine* this) {
-
-        }
-
-        //main
-        void ?main(MyCoroutine* this) {
-                sout | "Hello World!" | endl;
-        }
-\end{lstlisting}
-
-One a coroutine is created, users can context switch to it using \code{suspend} and come back using \code{resume}. Here is an example of a solution to the fibonnaci problem using coroutines :
-\begin{lstlisting}
-        coroutine struct Fibonacci {
-                int fn; // used for communication
-        };
-
-        void ?main(Fibonacci* this) {
-                int fn1, fn2;           // retained between resumes
-                this->fn = 0;
-                fn1 = this->fn;
-                suspend(this);          // return to last resume
-
-                this->fn = 1;
-                fn2 = fn1;
-                fn1 = this->fn;
-                suspend(this);          // return to last resume
-
-                for ( ;; ) {
-                        this->fn = fn1 + fn2;
-                        fn2 = fn1;
-                        fn1 = this->fn;
-                        suspend(this);  // return to last resume
-                }
-        }
-
-        int next(Fibonacci& this) {
-                resume(&this); // transfer to last suspend
-                return this.fn;
-        }
-
-        void main() {
-                Fibonacci f1, f2;
-                for ( int i = 1; i <= 10; i += 1 ) {
-                        sout | next(f1) | '§\verb+ +§' | next(f2) | endl;
-                }
         }
 \end{lstlisting}

doc/proposals/concurrency/version

@@ -1 @@
-0.7.48
+0.7.61

src/libcfa/concurrency/threads

@@ -15 +15 @@
 //
 
-#ifndef __THREADS_H__
-#define __THREADS_H__
+#ifdef __CFORALL__
+
+#ifndef THREADS_H
+#define THREADS_H
 
 #include "assert"       //
@@ -111 +113 @@
 }
 
-#endif //__THREADS_H__
+#endif //THREADS_H
+
+#else
+#include_next <thread>
+#endif //__CFORALL__
 
 // Local Variables: //

src/libcfa/containers/vector

@@ -14 +14 @@
 //
 
-#pragma once
+#ifdef __CFORALL__
+
+#ifndef VECTOR_H
+#define VECTOR_H
 
 extern "C" {
@@ -165 +168 @@
 }
 
+#endif // VECTOR_H
+
+#else
+#include_next <vector>
+#endif //__CFORALL__
+
 // Local Variables: //
 // mode: c //

src/libcfa/fstream

@@ -13 +13 @@
 // Update Count     : 88
 //
+
+#ifdef __CFORALL__
 
 #ifndef __FSTREAM_H__
@@ -62 +64 @@
 #endif // __FSTREAM_H__
 
+#else
+#include_next <fstream>
+#endif //__CFORALL__
+
 // Local Variables: //
 // mode: c //

src/libcfa/iostream

@@ -13 +13 @@
 // Update Count     : 93
 //
+
+#ifdef __CFORALL__
 
 #ifndef __IOSTREAM_H__
@@ -124 +126 @@
 forall( dtype istype | istream( istype ) ) istype * ?|?( istype *, _Istream_cstrC );
 
-#endif // __IOSTREAM_H__
+#endif // __IOSTREAM_H
+
+#else
+#include_next <iostream>
+#endif //__CFORALL__
 
 // Local Variables: //

src/libcfa/iterator

@@ -13 +13 @@
 // Update Count     : 9
 //
+
+#ifdef __CFORALL__
 
 #ifndef ITERATOR_H
@@ -46 +48 @@
 #endif // ITERATOR_H
 
+#else
+#include_next <iterator>
+#endif //__CFORALL__
+
 // Local Variables: //
 // mode: c //

src/libcfa/limits

@@ -13 +13 @@
 // Update Count     : 6
 // 
+
+#ifdef __CFORALL__
+
+#ifndef LIMITS_H
+#define LIMITS_H
 
 // Integral Constants
@@ -107 +112 @@
 extern const long _Complex _1_SQRT_2;                                   // 1 / sqrt(2)
 
+#endif // LIMITS_H
+
+#else
+#include_next <limits>
+#endif //__CFORALL__
+
 // Local Variables: //
 // mode: c //

src/libcfa/math

@@ -14 +14 @@
 // 
 
+#ifdef __CFORALL__
+
+#ifndef MATH_H
+#define MATH_H
+
 extern "C" {
 #include <math.h>                                                                               // fpclassify, isfinite, isnormal, isnan, isinf
@@ -349 +354 @@
 long double scalbln( long double, long int );
 
+#endif // MATH_H
+
+#else
+#include_next <math>
+#endif //__CFORALL__
+
 // Local Variables: //
 // mode: c //

src/libcfa/rational

@@ -15 +15 @@
 // Update Count     : 16
 // 
+#ifdef __CFORALL__
+
+#ifndef RATIONAL_H
+#define RATIONAL_H
 
 #include "iostream"
@@ -61 +65 @@
 forall( dtype ostype | ostream( ostype ) ) ostype * ?|?( ostype *, Rational );
 
+#endif // RATIONAL_H
+
+#else
+#include_next <rational>
+#endif //__CFORALL__
+
 // Local Variables: //
 // mode: c //

src/libcfa/stdlib

@@ -13 +13 @@
 // Update Count     : 99
 //
+
+#ifdef __CFORALL__
+
+#ifndef STDLIB_H
+#define STDLIB_H
 
 //---------------------------------------
@@ -131 +136 @@
 void swap( T * t1, T * t2 );
 
+#endif // STDLIB_H
+
+#else
+#include_next <stdlib>
+#endif //__CFORALL__
+
 // Local Variables: //
 // mode: c //