UTAS Home › Faculty of Science Engineering and Technology › School of Mathematics & Physics › Research › Mathematics › Operations Research & Stochastic Modeling
Operations Research is a field of expertise that is highly sought-after by industry, to which it contributes millions of dollars in benefits and savings each year.
OR skills are applied in a wide range of areas, including Accounting, Actuarial Work, Computer Services, Corporate Planning, Economic Analysis, Financial Modelling, Industrial Engineering, Investment Analysis, Logistics, Manufacturing Services, Management Services, Management Training, Market Research, Operations Research, Planning, Production Engineering, Quantitative Methods, Strategic Planning, Systems Analysis, Transport Economics. For more information about OR and career opportunities see: 
Fig 1: A Markov chain with 6 states, with arrows indicating allowed transitions between states.
Stochastic Modeling is a research area within Operations Research that focuses on developing probabilistic models for real-life systems having an element of uncertainty. The work involves constructing useful models, analyzing them analytically, deriving mathematical expressions for various important performance measures, and building efficient algorithms for their numerical evaluations. Markov Chains is the most important class of stochastic models due to their powerful modeling features, numerical tractability, and applicability to a wide range of real-life systems of great engineering or environmental significance. A Markov Chain, named for Andrey Markov, is a mathematical system that undergoes transitions from one state to another, between a finite or countable number of possible states. It is a random process characterized as memoryless: the next state depends only on the current state and not on the sequence of events that preceded it. This specific kind of "memorylessness" is called the Markov property.
Markovian-modulated models are built on the concept of Markov Chains. Their state space is two-dimensional and consists of the phase variable i(t) and the level variable X(t). Phase is used to model the state of some real-life environment, while level is used to model its performance measure at time t. We assume that the phase changes according to some underlying Markov Chain. Further, we assume that the rate at which the level changes at time t depends on the current phase i(t). For example, in the modeling of a telecommunications buffer, the phase may represent the operating switch, while the level may be the amount of data in the buffer. The rate at which the buffer empties or fills in, depends on which switch is on. See the diagram of a simple two-phase model (with on and off phase) and a graph illustrating the evolution of X(t) in time below.

Markovian-modulated models have attracted a lot of interest due to their applicability to a wide range of real-life systems of great engineering or environmental significance, well beyond applications in high-speed telecommunications systems, for which they were originally derived. Very interesting results for this class of models have been obtained in recent years. The recent developments are in 2-dimensional models. The applications of these include ad-hoc mobile networks, the process of coral bleaching, and operation of hydro-power generation, amongst other examples.
This simulation shows the evolution in time of a Stochastic 2-Dimensional Fluid model (i(t),X(t),Y(t)) with a lower boundary.
We assume that {i(t)} is a continuous-time Markov Chain (CTMC). Further, the rate of change in X(t) is a constant c(i) given the current phase of the CTMC is i. Similarly, the rate of change in Y(t) is a constant r(i) given the current phase of the CTMC is i.
In this example, there is a clear drift of both X(t) and Y(t) towards zero. Here, both X(t) and Y(t) are bounded from below by level zero.
If you are interested in post-graduate study in Operations Research, feel free to contact Dr O'Reilly to discuss possibilities. Also, see the examples of topics below.
Dr MaĆgorzata O'Reilly
School of Mathematics & Physics, University of Tasmania
Private Bag 37, Hobart, Tasmania 7001, Australia; Room: 455
Phone: +61 3 6226 2405, Fax: +61 3 6226 2410
Email: Malgorzata.OReilly@utas.edu.au, Skype: malgorzata.oreilly
Contact: Malgorzata O'Reilly
Authorised by the Head of School, Mathematics & Physics
8 March, 2013
Future Students | International Students | Postgraduate Students | Current Students
© University of Tasmania, Australia ABN 30 764 374 782 CRICOS Provider Code 00586B
Copyright | Privacy | Disclaimer | Web Accessibility | Site Feedback | Info line 1300 363 864