Solving for Steady-State Solutions

Introduction

For time-independent open quantum systems with decay rates larger than the corresponding excitation rates, the system will tend toward a steady state as \(t\rightarrow\infty\) that satisfies the equation

\[\frac{d\hat{\rho}_{ss}}{dt}=\mathcal{L}\hat{\rho}_{ss}=0.\]

Although the requirement for time-independence seems quite resitrictive, one can often employ a transformation to the interaction picture that yields a time-independent Hamiltonian. For many these systems, solving for the asymptotic density matrix \(\hat{\rho}_{ss}\) can be achieved using direct or iterative solution methods faster than using master equation or Monte Carlo simulations. Although the steady state equation has a simple mathematical form, the properties of the Liouvillian operator are such that the solutions to this equation are anything but straightforward to find.

Steady State Solutions for Arbitrary Systems

Steady State solvers in QuTiP

In QuTiP, the steady-state solution for a system Hamiltonian or Liouvillian is given by qutip.steadystate.steadystate. This function implements a number of different methods for finding the steady state, each with their own pros and cons, where the method used can be chosen using the method keyword argument.

Available Steady-State Methods:

Method Keyword Description
Direct (default) ‘direct’ Direct solution solving \(Ax=b\) via sparse LU decomposition.
Eigenvalue ‘eigen’ Iteratively find the eigenvector corresponding to the zero eigenvalue of \(\mathcal{L}\).
Inverse-Power ‘power’ Iteratively solve for the steady-state solution using the inverse-power method.
GMRES ‘iterative-gmres’ Iteratively solve for the steady-state solution using the GMRES method and optional preconditioner.
LGMRES ‘iterative-lgmres’ Iteratively solve for the steady-state solution using the LGMRES method and optional preconditioner.
BICGSTAB ‘iterative-bicgstab’ Iteratively solve for the steady-state solution using the BICGSTAB method and optional preconditioner.
SVD ‘svd’ Steady-state solution via the SVD of the Liouvillian represented by a dense matrix.

The function qutip.steadystate.steadystate can take either a Hamiltonian and a list of collapse operators as input, generating internally the corresponding Liouvillian super operator in Lindblad form, or alternatively, an arbitrary Liouvillian passed by the user. When possible, we recommend passing the Hamiltonian and collapse operators to qutip.steadystate.steadystate, and letting the function automatically build the Liouvillian for the system.

Using the Steadystate Solver

Solving for the steady state solution to the Lindblad master equation for a general system with qutip.steadystate.steadystate can be accomplished using:

>>> rho_ss = steadystate(H, c_ops)

where H is a quantum object representing the system Hamiltonian, and c_ops is a list of quantum objects for the system collapse operators. The output, labeled as rho_ss, is the steady-state solution for the systems. If no other keywords are passed to the solver, the default ‘direct’ method is used, generating a solution that is exact to machine precision at the expense of a large memory requirement. The large amount of memory need for the direct LU decomposition method stems from the large bandwidth of the system Liouvillian and the correspondingly large fill-in (extra nonzero elements) generated in the LU factors. This fill-in can be reduced by using bandwidth minimization algorithms such as those discussed in Additional Solver Arguments. Additional parameters may be used by calling the steady-state solver as:

>>> rho_ss = steadystate(H, c_ops, method='power', use_rcm=True)

where method='power' indicates that we are using the inverse-power solution method, and use_rcm=True turns on the bandwidth minimization routine.

Although it is not obvious, the 'direct', eigen, and 'power' methods all use an LU decomposition internally and thus suffer from a large memory overhead. In contrast, iterative methods such as the 'iterative-gmres', 'iterative-lgmres', and 'iterative-bicgstab' methods do not factor the matrix and thus take less memory than these previous methods and allowing, in principle, for extremely large system sizes. The downside is that these methods can take much longer than the direct method as the condition number of the Liouvillian matrix is large, indicating that these iterative methods require a large number of iterations for convergence. To overcome this, one can use a preconditioner \(M\) that solves for an approximate inverse for the (modified) Liouvillian, thus better conditioning the problem, leading to faster convergence. The use of a preconditioner can actually make these iterative methods faster than the other solution methods. The problem with precondioning is that it is only well defined for Hermitian matrices. Since the Liouvillian is non-Hermitian, the ability to find a good preconditioner is not guaranteed. And moreover, if a preconditioner is found, it is not guaranteed to have a good condition number. QuTiP can make use of an incomplete LU preconditioner when using the iterative 'gmres', 'lgmres', and 'bicgstab' solvers by setting use_precond=True. The preconditioner optionally makes use of a combination of symmetric and anti-symmetric matrix permutations that attempt to improve the preconditioning process. These features are discussed in the Additional Solver Arguments section. Even with these state-of-the-art permutations, the generation of a successful preconditoner for non-symmetric matrices is currently a trial-and-error process due to the lack of mathematical work done in this area. It is always recommended to begin with the direct solver with no additional arguments before selecting a different method.

Finding the steady-state solution is not limited to the Lindblad form of the master equation. Any time-independent Liouvillian constructed from a Hamiltonian and collapse operators can be used as an input:

>>> rho_ss = steadystate(L)

where L is the Louvillian. All of the additional arguments can also be used in this case.

Additional Solver Arguments

The following additional solver arguments are available for the steady-state solver:

Keyword Options (default listed first) Description
method ‘direct’, ‘eigen’, ‘power’, ‘iterative-gmres’,’iterative-lgmres’, ‘svd’ Method used for solving for the steady-state density matrix.
sparse True, False Use sparse version of direct solver.
weight None Allows the user to define the weighting factor used in the 'direct', 'GMRES', and 'LGMRES' solvers.
permc_spec ‘COLAMD’, ‘NATURAL’ Column ordering used in the sparse LU decomposition.
use_rcm False, True Use a Reverse Cuthill-Mckee reordering to minimize the bandwidth of the modified Liouvillian used in the LU decomposition. If use_rcm=True then the column ordering is set to 'Natural' automatically unless explicitly set.
use_umfpack False, True Use the umfpack solver rather than the default superLU. on SciPy 0.14+, this option requires installing the scikits.umfpack extension.
use_precond False, True Attempt to generate a preconditioner when using the 'iterative-gmres' and 'iterative-lgmres' methods.
M None, sparse_matrix, LinearOperator A user defined preconditioner, if any.
use_wbm False, True Use a Weighted Bipartite Matching algorithm to attempt to make the modified Liouvillian more diagonally dominate, and thus for favorable for preconditioning. Set to True automatically when using a iterative method, unless explicitly set.
tol 1e-9 Tolerance used in finding the solution for all methods expect 'direct' and 'svd'.
maxiter 10000 Maximum number of iterations to perform for all methods expect 'direct' and 'svd'.
fill_factor 10 Upper-bound on the allowed fill-in for the approximate inverse preconditioner. This value may need to be set much higher than this in some cases.
drop_tol 1e-3 Sets the threshold for the relative magnitude of preconditioner elements that should be dropped. A lower number yields a more accurate approximate inverse at the expense of fill-in and increased runtime.
diag_pivot_thresh None Sets the threshold between \([0,1]\) for which diagonal elements are considered acceptable pivot points when using a preconditioner.
ILU_MILU ‘smilu_2’ Selects the incomplete LU decomposition method algorithm used.

Further information can be found in the qutip.steadystate.steadystate docstrings.

Example: Harmonic Oscillator in Thermal Bath

A simple example of a system that reaches a steady state is a harmonic oscillator coupled to a thermal environment. Below we consider a harmonic oscillator, initially in the \(\left|10\right>\) number state, and weakly coupled to a thermal environment characterized by an average particle expectation value of \(\left<n\right>=2\). We calculate the evolution via master equation and Monte Carlo methods, and see that they converge to the steady-state solution. Here we choose to perform only a few Monte Carlo trajectories so we can distinguish this evolution from the master-equation solution.

In [1]: N = 20  # number of basis states to consider

In [2]: a = destroy(N)

In [3]: H = a.dag() * a

In [4]: psi0 = basis(N, 10)  # initial state

In [5]: kappa = 0.1  # coupling to oscillator

In [6]: c_op_list = []

In [7]: n_th_a = 2  # temperature with average of 2 excitations

In [8]: rate = kappa * (1 + n_th_a)

In [9]: c_op_list.append(sqrt(rate) * a)  # decay operators

In [10]: rate = kappa * n_th_a

In [11]: c_op_list.append(sqrt(rate) * a.dag())  # excitation operators

In [12]: final_state = steadystate(H, c_op_list)

In [13]: fexpt = expect(a.dag() * a, final_state)

In [14]: tlist = linspace(0, 50, 100)

In [15]: mcdata = mcsolve(H, psi0, tlist, c_op_list, [a.dag() * a], ntraj=100)
10.0%. Run time:   0.41s. Est. time left: 00:00:00:03
20.0%. Run time:   0.82s. Est. time left: 00:00:00:03
30.0%. Run time:   1.17s. Est. time left: 00:00:00:02
40.0%. Run time:   1.61s. Est. time left: 00:00:00:02
50.0%. Run time:   2.01s. Est. time left: 00:00:00:02
60.0%. Run time:   2.35s. Est. time left: 00:00:00:01
70.0%. Run time:   2.65s. Est. time left: 00:00:00:01
80.0%. Run time:   3.01s. Est. time left: 00:00:00:00
90.0%. Run time:   3.43s. Est. time left: 00:00:00:00
100.0%. Run time:   3.82s. Est. time left: 00:00:00:00
Total run time:   3.87s

In [16]: medata = mesolve(H, psi0, tlist, c_op_list, [a.dag() * a])

In [17]: figure()
Out[17]: <matplotlib.figure.Figure at 0x10dad5910>

In [18]: plot(tlist, mcdata.expect[0], tlist, medata.expect[0], lw=2)
Out[18]: 
[<matplotlib.lines.Line2D at 0x10db8d750>,
 <matplotlib.lines.Line2D at 0x10db8d9d0>]

In [19]: axhline(y=fexpt, color='r', lw=1.5) # ss expt. value as horiz line (= 2)
Out[19]: <matplotlib.lines.Line2D at 0x10da59150>

In [20]: ylim([0, 10])
Out[20]: (0, 10)

In [21]: xlabel('Time', fontsize=14)
Out[21]: <matplotlib.text.Text at 0x10da59cd0>

In [22]: ylabel('Number of excitations', fontsize=14)
Out[22]: <matplotlib.text.Text at 0x10da88a50>

In [23]: legend(('Monte-Carlo', 'Master Equation', 'Steady State'))
Out[23]: <matplotlib.legend.Legend at 0x10d932fd0>

In [24]: title('Decay of Fock state $\left|10\\rangle\\right.$' +
   ....: ' in a thermal environment with $\langle n\\rangle=2$')
   ....: 
Out[24]: <matplotlib.text.Text at 0x10da84550>

In [25]: show()
../images/guide-steady1.png