OpenFrontiers
← Back to the index
OP-8739Status unassessedProbability

Hitting time of trajectory

Markov chain mixing times · Historical workshop question

Editorial mapping of AIMPL source category: Probability. http://aimpl.org/markovmixing/ Not an author-supplied MSC code.

Historical list · status unassessedAs of 2026-09-08Source & evidence ↓

Problem statement

Consider a nonreversible (say 23\frac 23--13\frac 13) random walk on an Eulerian digraph (V,E)(V,E). Prove that the first time, τ(Xt(y))\tau_{(X^{(y)}_t)} the random walk hits a moving target Xt(y)X^{(y)}_t with X0=yX_0=y satisfies the following: max⁡x,yEx[τ(Xt(y))]≤∣E∣ ∣V∣\max_{x,y} \mathbb E_x [\tau_{(X_t^{(y)})}] \leq |E|\,|V|.

Lean 4

Not yet attached

No Lean statement or proof is attached yet. Have a formalization? Share its source to add it to this problem.

Background

Workshop introduction

In general, we will use the following notation in the problem list. We consider aperiodic irreducible Markov chains on a state space, Ω\Omega with unique invariant (stationary) distribution π\pi. In the discrete time setting we allow the matrix (P)x,y∈Ω(P)_{x,y\in\Omega} with Pxy=P(x,y)P_{xy}=P(x,y) to denote the transition matrix of the Markov chain.

A chain is reversible if π(x)P(x,y)=π(y)P(y,x)\pi(x)P(x,y)=\pi(y)P(y,x) for all x,y∈Ωx,y\in\Omega. Q(x,y)=π(x)P(x,y)Q(x,y)=\pi(x)P(x,y) is the edge measure on (x,y)(x,y). We denote by t\mboxmixt_{\mbox{mix}} the total variation mixing time defined as

t\mboxmix(ϵ)=inf⁡{t:sup⁡ω0∈Ω∥Pt(ω0,⋅)−π(⋅)∥TV≤ϵ} ,t_{\mbox{mix}}(\epsilon)=\inf\{t:\sup_{\omega_0\in\Omega}\|P^t(\omega_0,\cdot)-\pi(\cdot)\|_{TV}\leq \epsilon\}\,,

and set t\mboxmix=t\mboxmix(ϵ)t_{\mbox{mix}}=t_{\mbox{mix}}(\epsilon), where the total variation distance

∥μ−ν∥TV=12∥μ−ν∥ℓ1 .\|\mu-\nu\|_{TV}=\tfrac 12 \|\mu-\nu\|_{\ell^1}\,.

Section context

For a nonreversible chain with transition matrix P(x,y)P(x,y), define its time-reversal by P^(x,y)=(π(x))−1π(y)P(y,x)\hat P(x,y)=(\pi(x))^{-1}\pi(y)P(y,x). Then the symmetrization of the chain is given by the Markov chain with transition matrix 12(P+P^)\frac 12 (P+\hat P).

Progress & source assessment

Historical workshop record. Current open/solved status has not been independently reassessed.

Status note in the source

Such an upper bound is known for the mixing time. The current best bound on the hitting time of a trajectory is ∣E∣∣V∣(1+log⁡∣E∣∣V∣)|E||V|(1+\log \frac {|E|}{|V|}).

References
  1. [1]Markov chain mixing times link

Recorded progress

Add yours →

Nothing recorded yet. A pointer to a paper the entry is missing counts.

Machine attempts

0 recorded

Attempts run against the statement below and are recorded in full, including the failures. The point is to stop the next model — and the next person — from re-walking a road that is already known to end. Each attempt costs 25 credits.

No machine attempts recorded.

Sign in to run an attempt. New accounts start with enough credits for ten.

Discussion

0 notes

Notes are for clarifying the statement, flagging a missing reference, or recording why an approach fails. Claimed solutions belong in a submission, where they can be reviewed.

No notes yet.

Sign in to add a note.