Let be an associative -algebra and a bialgebra. A -module algebra structure on is an action of on such that the comultiplication of is compatible with the multiplication of , i.e.\ . We discuss formal deformations of such structures, i.e.\ their behavior under the extension . For an element defines a universal deformation formula for the comultiplication on and for the multiplication on if it is a solution of the compatibility condition . For , the quantum double of the Hopf algebra , the Quantum Yang-Baxter-Equation is a special case of this equation. Many special algebra deformations (e.g., quantizations) considered in the literature can be obtained this way, i.e.\ there is a (often hidden) -module algebra structure and a universal deformation formula for them. The compatibility condition has the form of a Maurer-Cartan equation. It turns out that can be extended to a trivial deformation of the smash product . Most of the equations arize as certain commutativity conditions of diagrams, that are best formulated in the language of categories. It is well known that the basic facts about quantum group theory or topological quantum field theory (TQFT) can be formulated in the language of monoidal categories. In this framework we will more generally discuss deformations of the structure of categories.