Eigil Fjeldgren Rischel 2024 6 5 https://erischel.com/efr-0008/ efr-0008 /efr-0008/ Acknowledgements I would like to extend a great thanks to the Mathematically Structured Programming group at the University of Strathclyde, my fellow PhD students in particular, for making my time there such a great one. A good chunk of this work was completed while I worked at the Compositional Systems Laboratory at the Tallinn University of Technology---I owe everyone there a great thanks as well. For conversations which contributed to this work, and to my mathematical development in general, I would like to thank Dylan Braithwaite, Matteo Capucci, Elena di Lavore, Tobias Fritz, Davidad, Tomáš Gonda, Bruno Gavranović, Diana Kessler, Owen Lynch, Jade Master, David Jaz Myers, Riu Nakamura, Chad Nester, Evan Patterson, Paolo Perrone, Mario Roman, Brandon Shapiro, Toby Smithe, Pawel Sobocinski, David Spivak, and Andre Videla. A special thanks to Dylan, Matteo, and Bruno, for serving their time with me in the dependent optics mines. To Neil Ghani, Radu Mardare, and Jules Hedges, a massive thanks for serving as my advisors during the somewhat tumultuous process that was the production of this thesis. Finally, I thank my wonderful family. Now you can stop asking me about it. References Context Eigil Fjeldgren Rischel 2025 4 6 https://erischel.com/efr-HQ73/ efr-HQ73 /efr-HQ73/ Markov Fibrations › Introduction In applying category theory to fields as diverse as game theory (Reference ,Reference , Reference ), machine learning (Reference , Reference ), dynamical systems (Reference , Reference ), and server design (Reference ), people have found it useful to study categories whose morphisms describe processes or functions that take place in two "stages", where the second is dependent on the first, but composes in the other direction---so-called lenses. In many of these domains, stochastic phenomena play a role. There is a useful generalization of lenses to categories of stochastic maps---the so-called optics of Riley, Reference ---but this does not accommodate another useful generalization, so called dependent lenses where not only the backwards process but the set it takes values in is indexed over the base. It has been a long-standing problem to develop a suitable common generalization, "dependent optics", of these two ideas. In this thesis, we solve this problem by developing a theory of Markov fibrations (§ ). A Markov fibration is a weakening of the notion of (Grothendieck) fibration to include (subject to some assumptions) Markov categories of indexed families of objects (given by deterministic functions ) and compatible stochastic maps (given by commutative squares). The main point of Markov fibrations is that they admit fiberwise opposites, which generalize the fiberwise opposites of ordinary categories. Just as the fiberwise opposite of the codomain fibration of a finitely complete category describes dependent lenses (see § ), the fiberwise opposite of these codomain Markov fibrations give a good notion of stochastic lens (see Theorem ). We will apply our theory chiefly to two problems. First, we will use them to generalize open games (Hedges, Reference ) to a larger class of interfaces (namely, indexed families of sets) while at the same time considering possibly-stochastic maps. This will allow us to construct the so-called external choice operator on open games, which describes branching. Secondly, we will generalize Myers' categorical dynamical systems theory to allow for stochastic maps in the base. When combined with another generalization of these systems, to general parametrized lenses, this gives a more natural way of modeling certain stochastic dynamical systems, such as those associated to the training dynamics of machine learning models, see eg Example . Eigil Fjeldgren Rischel 2025 4 6 A brief introduction to lenses If is a category with finite products, the category of lenses in has objects pairs of objects in , and morphisms given by pairs . (Note that it is of course the morphisms, not the objects, that are called lenses). One way to generalize this is to ask for to have pullbacks, and consider an object given by a more general map , and let a map be (so that the triangle over commutes). (Note that this recovers the "simple lenses" when the objects are of the form ). Under the interpretation of a map as a family of objects indexed over the elements of , we see this as a "dependent lens" (since is a "dependent type"). There are various variations of this idea, which ultimately all fit the pattern of taking a Grothendieck fibration and forming the fiberwise opposite---for the dependent lenses as above, this is the codomain fibration . Meanwhile, another wide-ranging generalization of are the optics of Riley (Reference ). For a monoidal category, the objects of are again pairs of objects, but now the morphisms are elements of the coend That is, to give an optic is to give an object and morphisms , up to the equivalence relation generated by, whenever identifying the two optics given by and . One can show that, in the case where is a Cartesian monoidal category, this set can be identified with the set of (simple) lenses. A vector field on a smooth manifold is simply a (smooth) section of the tangent bundle . A section is a bundle map from the trivial bundle . This gives the idea of considering a parametrized dynamical system as consisting of a map to some other smooth manifold, a bundle (the points of are the parameters) and a bundle map . As we will see, such a bundle map is exactly a dependent lens in a category of bundles. Building on this idea, Myers (Reference ) described a highly abstract theory of open dynamical systems, given by lenses out of tangent bundles (where the notion of space, bundle and tangent bundle are generalized to any fibration). It has been observed that, although a lens from the tangent bundle may indeed be said to describe an open dynamical system with state space , the same can be said for a lens of type ---although a dynamical system of a different kind (essentially, the first type are the Moore machines, the second the Mealy machines---see the introduction to § for more on this). It is natural to consider parametrized maps as a common generalization of these two concepts---and in fact, special cases of this idea, lenses parametrized by tangent bundles, have already been considered many times, for example in the semantics of gradient descent (see Reference , Reference , Reference ). Since parametrized maps compose in an obvious way, we now have three different notions of morphisms between bundles---lenses, charts, and "generalized systems". These should form some sort of symmetric monoidal triple category, but the right axiomatisation of this concept is somewhat elusive. Lenses, in their various incarnations, have been widely used in applied category theory. For example, Hedges and his collaborators have developed a compositional approach to game theory (Reference , Reference , Reference , Reference , others). Recent work by Hedges and Sakamoto bring this idea to reinforcement learning (Reference ). We briefly mentioned Myers' categorical systems theory above, and we will see much more of it later. As we discussed above, there is also a literature using lenses to study gradient descent in an abstract sense. This is without even mentioning their original role in the theory of functional programming (this is the origin of the somewhat confusing term lens), or their prehistory in Gödel's dialectica interpretation---see eg Reference for a survey of this. Eigil Fjeldgren Rischel 2025 4 6 Dependent Optics An open game, in the sense of Hedges, has as its interface two objects in the category of lenses (of sets) (that is, two pairs of sets). An open game with this interface consists of a set of strategies equipped with a function and a subset of equilibrium strategies for each and ---note that such an is exactly a lens and such a is exactly a lens . This view of open games makes the composition rule much simpler to define, although we will not delve into the details here, see eg Reference . The idea is that the open game represents the strategies and preferences of a player or set of players--- are the possible strategies, is the information revealed to the player before they make their decision of which moves to make, the resulting is the choice the player "sends" in response to , and the is the "utility", the value they eventually learn, depending on their choice , which they have some preferences over. The above description gives a theory of deterministic games, but of course, it is completely essential for game theory to model both random decisions (mixed strategies) and decisions made under uncertainty. This motivates the replacement of lenses in this definition with optics in a category of probability kernels (the form of the equilibrium relation must be modified as well, see Reference , Reference ) In the abstract study of open games, it is desirable to define a "choice" operation on the objects (the pairs of sets) so that maps into represent players who are faced with some binary choice between and , after which play may proceed for a time in one of two branches. However, this is immediately problematic because the category of lenses do not have coproducts---inside the category of dependent lenses, however, we can form the coproduct simply as ---that is, we get a family which is over , and over . This indeed does the job, but for game theory the extension to stochastic maps---optics---is absolutely essential. This motivates the search for a theory of dependent optics, a common generalization of optics and dependent lenses. There have been a number of attempts at this---see eg Reference , Reference , Reference , Reference . While these efforts have to some extent succeeded in describing a theory that is general enough to contain the desired examples, it is generally very ad hoc. The construction of optics as a special case of Vertechi's dependent optics (Reference ) gives them as fibre optics with the indexing bicategory being (the delooping of) a monoidal category , but embeds lenses using a bicategory of spans. Thus simple lenses admit two distinct encodings in this theory. Moreover, Vertechi's example of dependent monoidal optics fails to describe a supercategory of when applied to Markov categories, and are thus not suitable for, for example, game theory. Eigil Fjeldgren Rischel 2025 4 6 Categorical Cybernetics The observation that both open games and machine learning systems can be fruitfully described using lenses, naturally led to the idea that this could be used to develop a more thorough analogy between the two. After all, a machine learning system is also a player in a kind of game (with the objective of minimizing loss). Hedges coined the phrase categorical cybernetics to describe this locus of ideas (Reference , also used in Reference ). Myers' categorical systems theory also describes dynamical systems as lenses. However, where a cybernetic system in the sense of Reference is a parametrized lens and thus has two different inputs - which is the information on which basis they are allowed to choose their decision and which is their "utility", the information they are allowed to care about. It is straightforward to describe the machine learning part of the categorical cybernetics analogy in terms of Myers' theory---a "learner" is simply a lens of the above form with replace with a tangent bundle . This idea (described in these terms, although not with the analogy to machine learning) has already been described by Reference . However, for game theory, it is necessary that the output of a given system can be stochastically chosen (a player must be able to randomize their strategy). At the same time, for a machine learning system, the is usually some sort of sample from a training distribution---ie, it is random. Hence to really describe the training dynamics of machine learning systems using this theory, we are again naturally drawn to consider systems theories (that is, fibrations) which have stochastic maps in the base, not merely the fiber. Eigil Fjeldgren Rischel 2025 4 6 Overview and contributions We begin the thesis in § with a review of some preliminary material. This chapter can largely be skipped for readers already familiar with the material (Markov categories, double categories, lenses and optics, fibrations, and categorical dynamical systems theory). The chapter on Markov categories introduces a few novel auxiliary notions, but these can be referred back to as necessary (they are primarily regularity conditions which hold in most Markov categories of interest). In § , we give the main technical contribution of the thesis by developing a theory of Markov fibrations. Their fiberwise opposites generalize both the fiberwise opposites of codomain fibrations (dependent lenses in a classical sense) and optics in Markov categories. Theorem provides the statement of the latter (the former is straightforward). We also give a description of monoidal structures on Markov fibrations (which pass to monoidal structures on the resulting categories of optics). In § , we give a construction of the double category of parametrized morphisms for a category action (or actegory)---in fact, we do this internally to any -category. This has the advantage of allowing us to construct more highly-structured versions of this double category by carrying out the construction internally to higher-structured actions. (Bicategorical versions of are a relatively old idea, and the double categorical version is a straightforward extension which has existed for some time as folklore, but the fully-internal construction here is novel). In § , we apply Markov fibrations to compositional game theory, and solve a longstanding problem by giving a category of stochastic open games with a general "external choice" operator. This construction is largely abstract over the particular category, and so can be applied to different Markov fibrations to describe games defined with different notions of stochasticity. We also review some previous work with Capucci, Hedges, and Gavranovic on abstract constructions of categories of open games (Reference ). In § , we describe how to extend Myers' categorical systems theory to Markov fibrations, to give theories of systems which may have stochastic maps not merely in the fiber (as was already described by Myers in Reference ) but also in the base. We also leverage our construction from § to give a description of a symmetric monoidal triple category whose three types of morphisms, are lenses, charts, and what we call bisystems, that is morphisms - these are open dynamical systems which have two directions of interaction with the environment. We also describe a particular systems theory of smooth manifolds and smooth stochastic maps between them. Eigil Fjeldgren Rischel 2024 6 5 https://erischel.com/efr-0008/ efr-0008 /efr-0008/ Acknowledgements I would like to extend a great thanks to the Mathematically Structured Programming group at the University of Strathclyde, my fellow PhD students in particular, for making my time there such a great one. A good chunk of this work was completed while I worked at the Compositional Systems Laboratory at the Tallinn University of Technology---I owe everyone there a great thanks as well. For conversations which contributed to this work, and to my mathematical development in general, I would like to thank Dylan Braithwaite, Matteo Capucci, Elena di Lavore, Tobias Fritz, Davidad, Tomáš Gonda, Bruno Gavranović, Diana Kessler, Owen Lynch, Jade Master, David Jaz Myers, Riu Nakamura, Chad Nester, Evan Patterson, Paolo Perrone, Mario Roman, Brandon Shapiro, Toby Smithe, Pawel Sobocinski, David Spivak, and Andre Videla. A special thanks to Dylan, Matteo, and Bruno, for serving their time with me in the dependent optics mines. To Neil Ghani, Radu Mardare, and Jules Hedges, a massive thanks for serving as my advisors during the somewhat tumultuous process that was the production of this thesis. Finally, I thank my wonderful family. Now you can stop asking me about it. Backlinks Related Contributions