Functional Concurrency in .NET
With examples in C# and F#
Riccardo Terrell
  • MEAP began December 2016
  • Publication in November 2017 (estimated)
  • ISBN 9781617292996
  • 500 pages (estimated)
  • printed in black & white

The multicore processor revolution has begun. Parallel computation is powerful and increasingly accessible and multicore computation is incorporated into all sorts of applications, including finance software, video games, web applications, machine-learning, and market analysis. To get the best performance, your application has to partition and divide processing to take full advantage of multicore processors. Functional languages help developers support concurrency by encouraging immutable data structures that can be passed between threads without having to worry about a shared state, all while avoiding side effects.

Functional Concurrency in .NET teaches you how to build concurrent and scalable programs in .NET using the functional paradigm. This intermediate-level guide is aimed at developers, architects, and passionate computer programmers who are interested in writing code with improved speed and effectiveness by adopting a declarative and pain-free programming style. You'll start by learning the foundations of concurrency and important functional techniques and paradigms used in the rest of the book. Then you'll dive in to concurrent and parallel programming designs, emphasizing the functional paradigm with both theory and practice with lots of code samples. The third part of the book covers a real "cradle to grave" application implementation, covering the techniques and skills learned during the book.

"The author is clearly well educated in the topic and does a great job of explaining the material."

~ Jeremy Lange

"Interesting look at the options for achieving structured concurrency in the .NET ecosystem. Accessible to those with minimal previous exposure to FP and category theory."

~ Andy Kirsch

Table of Contents detailed table of contents

Part 1: Functional Concurrent programming Concepts

1. Functional Concurrency Foundations

1.1. Let's start with terminology

1.1.1. Sequential programming

1.1.2. Parallelism

1.1.3. Multitasking

1.1.4. Multithreading

1.2. Why the need for concurrency?

1.2.1. Present and future of concurrent programming

1.3. The Pitfalls of Concurrent Programming

1.3.1. Concurrency hazards

1.3.2. The sharing-of-state evolution

1.3.3. A simple real-world example: parallel quicksort

1.3.4. Benchmarking in F#

1.4. Why Choose Functional Programming for Concurrency

1.4.1. Benefits of functional programming

1.5. Embracing the functional paradigm

1.6. Why use F# and C# for functional concurrent programming

1.7. Summary

2. Functional Programming Techniques for Concurrency

2.1. Function composition

2.1.1. Function composition in C#

2.1.2. Function composition in F#

2.2. Closure

2.2.1. Captured variables in closures with lambda expressions

2.2.2. Closure in a multithreading environment

2.3. Memoization-caching technique

2.3.1. Memoized web crawler

2.3.2. Lazy memoization for better performance

2.3.3. Gotchas for function memoization

2.4. Effective Concurrent Speculation

2.4.1. Precomputation with natural functional support

2.4.2. Let the best computation win

2.5. Being lazy is a good thing

2.5.1. Strict languages for better concurrency

2.5.2. Lazy caching technique and thread-safe singleton pattern

2.5.3. Lazy support in F#

2.5.4. Lazy and Task, a powerful combination

2.6. Summary

3. Functional Data Structures and Immutability

3.1. Real-world example - Hunt the thread-unsafe object

3.1.1. .NET immutable collections: a safe solution

3.1.2. The .NET concurrent collections: a faster solution

3.1.3. The Agent message passing pattern—​a faster and better solution

3.2. Functional data structure (FDS)

3.3. Immutability for a change

3.3.1. Functional data structure for data parallelism

3.3.2. Performance implication

3.3.3. Immutability in C#

3.3.4. Immutability in F#

3.3.5. Functional lists

3.3.6. Building a persistent data structure - an immutable binary tree (B-Tree)

3.4. Recursive function

3.4.1. The tail of a correct recursive function - Tail-Call optimized

3.4.2. Continuation passing style (CPS)

3.5. Summary

Part 2 How to approach different parts of a concurrent program

4. The Basics of Processing Big Data: Data Parallelism Part 1

4.1. What is data parallelism

4.1.1. Data and task parallelism

4.1.2. The "embarrassingly parallel" concept

4.1.3. Data parallelism support in .NET

4.2. The Fork/Join pattern: Parallel Mandelbrot

4.2.1. The downside of parallel loops

4.2.2. Amdahl's Law

4.2.3. Gustafson's Law

4.2.4. The limitations of parallel loops: the sum of prime numbers

4.2.5. What can possibly go wrong with a simple loop?

4.2.6. The declarative parallel programming model

4.3. Summary

5. PLINQ and Map-Reduce: Data Parallelism Part 2

5.1. A short introduction to PLINQ

5.1.1. How is PLINQ more functional?

5.1.2. PLINQ and pure functions: the parallel words counter

5.1.3. Isolate and control side effects: fixing the parallel words counter

5.2. Aggregating and reducing data in parallel

5.2.1. Deforesting: one of many advantages to folding

5.2.2. Fold in PLINQ: the Aggregate functions

5.2.3. Implementing a parallel Reduce function for PLINQ

5.2.4. Parallel list comprehension in F#: PSeq

5.2.5. Parallel array in F#

5.3. Parallel MapReduce pattern

5.3.1. The Map and Reduce functions

5.4. Summary

6. Real-Time Event Streams: Functional Reactive Programming (FRP)

6.1. What is Reactive programming: Big Event processing

6.2. .NET tools for Reactive programming

6.2.1. Event combinators - a better solution

6.2.2. .NET interoperability with F# combinators

6.3. Reactive programming in .NET: Reactive Extensions (Rx)

6.3.1. From LINQ/PLINQ to Reactive Extensions

6.3.2. IObservable - the dual IEnumerable

6.3.3. Reactive Extensions in action

6.3.4. Real-time streaming with Reactive Extensions

6.3.5. From events to F# observables

6.4. Taming the event stream - Twitter emotion analysis using Rx programming

6.5. An Rx publisher—​subscriber

6.5.1. The Subject type

6.5.2. Rx in relation to concurrency

6.5.3. Implementing a reusable Rx Publisher-Subscriber

6.5.4. Analyzing tweet emotions using an Rx Pub-Sub class

6.5.5. Observer in action

6.5.6. The convenient F# object expression

6.6. Summary

7. Task-Based Functional Parallelism

7.1. A short introduction to task parallelism

7.1.1. Why task parallelism and functional programming?

7.1.2. Task parallelism support in .NET

7.2. The .NET Task Parallel Library (TPL)

7.2.1. Running operations in parallel with TPL Parallel.Invoke

7.3. The problem of void

7.3.1. The solution of the Unit type

7.4. Continuation-passing style

7.4.1. Why exploit CPS?

7.4.2. Waiting for a task to complete - the continuation model

7.5. Strategies for composing task operations

7.5.1. Mathematical pattern for better composition

7.5.2. Guidelines for using tasks

7.6. The parallel functional pipeline pattern

7.7. Summary

8. Task Asynchronicity for the win

8.1. The Asynchronous Programming Model (APM)

8.1.1. The value of asynchronous programming

8.1.2. APM and scalability

8.1.3. CPU-bound and I/O-bound operations

8.2. Unbounded parallelism with asynchronous programming

8.3. Asynchronous support in .NET

8.3.1. Asynchronous programming breaks the code structure

8.3.2. Event-based asynchronous programming

8.4. The C# APM (Async/Await)

8.4.1. Anonymous asynchronous lambdas

8.4.2. Task<T> Asynchronous is a monadic container

8.5. Asynchronous processing: a case study

8.5.1. Asynchronous cancellation

8.5.2. Task-based asynchronous composition with the monadic Bind operator

8.5.3. Deferring asynchronous computation enables composition

8.5.4. Retry if something goes wrong

8.5.5. Handling errors in asynchronous operations

8.5.6. Asynchronous stock market parallel process

8.5.7. Asynchronous stock market parallel process as tasks complete

8.6. Summary

9. Asynchronous functional programming

9.1. The F# asynchronous workflow

9.1.1. The asynchronous workflow in action—Azure Blob storage parallel operations

9.1.2. The F# asynchronous workflow operators

9.1.3. Asynchronous workflow and computation expressions

9.1.4. Difference between computation expressions and monads

9.1.5. AsyncRetry—building your own computation expression

9.1.6. Extending the asynchronous workflow

9.1.7. Parallelize asynchronous workflows—Async.Parallel

9.1.8. Asynchronous workflow cancellation support

9.2. Asynchronous workflow functional error handling

9.3. Asynchronous functional aspect

9.4. Summary

10. Functional combinators and interoperability

11. Applying reactive programming everywhere with Agents

11.1. What is reactive programming, and how is it useful?

11.2. The asynchronous message-passing programming model

11.2.1. Message passing and immutability

11.2.2. Natural isolation

11.3. What is an agent?

11.3.1. The components of an agent

11.3.2. What an agent can do

11.3.3. The share-nothing approach for lock-free concurrent programming

11.3.4. How is agent-based programming functional?

11.3.5. Agent is object-oriented

11.4. The F# agent — MailboxProcessor

11.4.1. The mailbox asynchronous recursive loop

11.5. Avoiding database bottlenecks with F# MailboxProcessor

11.5.1. The MailboxProcessor message type — discriminated unions

11.5.2. The MailboxProcessor two-way communication

11.5.3. Consuming the AgentSQL from C#

11.5.4. Parallelize the workflow with a group-coordination of agents

11.5.5. How to handle errors with F# MailboxProcessor

11.5.6. Stop, cancel, and dispose MailboxProcessor — CancellationToken

11.5.7. Distributing the work with MailboxProcessor

11.5.8. Caching operations with an agent

11.5.9. Reporting results from a MailboxProcessor

11.5.10. Using the ThreadPool to report events from MailboxProcessor

11.6. The F# MailboxProcessor — a light agent — 10,000 agents for a game of life

11.7. Summary

12. Handling errors in a functional way

Part 3: Building your tool-box for success

13. Recipes and design patterns for successful concurrent programming

14. How to build a scalable and responsive mobile application using concurrent functional programming

Appendixes

Appendix A: Functional Programming

A.1. What is Functional Programming?

A.1.1. The benefits of functional programming

A.1.2. The tenets of functional programming

A.1.3. The clash of program paradigms - from imperative to object-oriented to functional programming

A.1.4. Higher-order functions for raising the abstraction

A.1.5. Higher-order functions and lambda expressions for code reusability

A.1.6. Lambda expressions and anonymous functions

A.1.7. Currying

A.1.8. Partially applied functions

A.1.9. Partial application benefits

A.1.10. The power of partial function application and currying in C#

Appendix B: F# overview

B.1. The "let" Binding

B.2. Understanding function signatures in F#

B.3. Create mutable types — mutable and ref

B.4. Functions as first class types

B.5. Composition - Pipe and Composition operators

B.6. Delegates

B.7. Comments

B.8. Open statements

B.9. Basic data types

B.10. Special String definition

B.11. Tuple

B.12. Record types

B.13. Discriminated unions

B.14. Pattern matching

B.15. Active patterns

B.16. Collections

B.17. Lists

B.18. Sequences (seq)

B.19. Arrays

B.20. Sets

B.21. Maps

B.22. Loops

B.23. Class and inheritance

B.24. Abstract classes and inheritance

B.25. Interfaces

B.26. Object expressions

B.27. Casting

B.28. Units of Measure

B.29. Resources

What's inside

  • Code examples in both C# and F#
  • Building high-performance concurrent systems
  • Integrating concurrent programming abstractions
  • Concurrent patterns such as fork/join, producer-consumer, Map-Reduce and pipeline
  • Implementing a real-time event stream processing
  • Seamlessly accelerate sequential programs by using data-parallel collections
  • Creating a data-access layer to handle massive concurrent requests

About the reader

This book is for readers with solid knowledge of a mainstream programming language, preferably C# or F#.

About the author

Riccardo Terrell is a .NET seasoned software engineer, senior software architect and Microsoft MVP who is passionate about functional programming. He is well known and actively involved in the functional programming community including .NET meet ups and conferences and is the organizer for the Washington DC F# User Group.


Manning Early Access Program (MEAP) Read chapters as they are written, get the finished eBook as soon as it’s ready, and receive the pBook long before it's in bookstores.
Buy
MEAP combo $59.99 pBook + eBook + liveBook
MEAP eBook $47.99 pdf + ePub + kindle + liveBook

FREE domestic shipping on three or more pBooks