1 / 78

# Simulation Techniques: Outline - PowerPoint PPT Presentation

Simulation Techniques: Outline. Lecture 1: Introduction: Statistical Mechanics, ergodicity, statistical errors.

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.

## PowerPoint Slideshow about ' Simulation Techniques: Outline' - yeo-harper

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

Lecture 1: Introduction:Statistical Mechanics, ergodicity, statistical errors.

Lecture 2: Molecular Dynamics: integrators, boundary conditions in space and time, long range potentials and neighbor tables, thermostats and constraints, single body and two body correlation functions, order parameters, dynamical properties.

Lecture 3: Monte Carlo Methods: MC vs. MD, Markov Chain MC, transition rules.

NB All material at beginner’s level. Interruptions welcomed!

D. Ceperley Simulation Methods

Introduction to Simulation:Lecture 1

• Why do simulations?

• Some history

• Review of statistical mechanics

• Newton’s equations and ergodicity

• The FPU “experiment”

• How to get something from simulations: statistical errors

D. Ceperley Simulation Methods

• Simulations are the only general method for “solving” many-body problems. Other methods involve approximations and experts.

• Experiment is limited and expensive. Simulations can complement the experiment.

• Simulations are easy even for complex systems.

• They scale up with the computer power.

D. Ceperley Simulation Methods

A. Give us the phenomena and invent a model to mimic the problem. The semi-empirical approach. But one cannot reliably extrapolate the model away from the empirical data.

B. Maxwell, Boltzmann and Schoedinger gave us the model. All we must do is numerically solve the mathematical problem and determine the properties. (first principles or ab initio methods) This is what we will talk about.

D. Ceperley Simulation Methods

“The general theory of quantum mechanics is now almost complete. The underlying physical laws necessary for the mathematical theory of a large part of physics and the whole of chemistry are thus completely known, and the difficulty is only that the exact application of these laws leads to equations much too complicated to be soluble.”

Dirac, 1929

D. Ceperley Simulation Methods

Challenges of Simulation complete. The underlying physical laws necessary for the mathematical theory of a large part of physics and the whole of chemistry are thus completely known, and the difficulty is only that the exact application of these laws leads to equations much too complicated to be soluble.”

Physical and mathematical underpinings:

• What approximations come in:

• Computer time is limitedfew particles for short periods of time. (space-time is 4d. Moore’s Law implies lengths and times will double every 6 years if O(N).)

• Systems with many particles and long time scales are problematical.

• Hamiltonian is unknown, until we solve the quantum many-body problem!

• How do we estimate errors? Statistical and systematic.

• How do we manage ever more complex codes?

D. Ceperley Simulation Methods

Short history of Molecular Simulations complete. The underlying physical laws necessary for the mathematical theory of a large part of physics and the whole of chemistry are thus completely known, and the difficulty is only that the exact application of these laws leads to equations much too complicated to be soluble.”

• Metropolis, Rosenbluth, Teller (1953) Monte Carlo Simulation of hard disks.

• Fermi, Pasta Ulam (1954) experiment on ergodicity

• Alder & Wainwright (1958) liquid-solid transition in hard spheres. “long time tails” (1970)

• Vineyard (1960) Radiation damage using MD

• Rahman (1964) liquid argon, water(1971)

• Verlet (1967) Correlation functions, ...

• Andersen, Rahman, Parrinello (1980) constant pressure MD

• Nose, Hoover, (1983) constant temperature thermostats.

• Car, Parrinello (1985) ab initio MD.

D. Ceperley Simulation Methods

Molecular Dynamics (MD) complete. The underlying physical laws necessary for the mathematical theory of a large part of physics and the whole of chemistry are thus completely known, and the difficulty is only that the exact application of these laws leads to equations much too complicated to be soluble.”

• Pick particles, masses and potential.

• Initialize positions and momentum. (boundary conditions in space and time)

• Solve F = m a to determine r(t), v(t).

Newton (1667-87)

• Compute properties along the trajectory

• Estimate errors.

• Try to use the simulation to answer physical questions.

D. Ceperley Simulation Methods

What are the forces? complete. The underlying physical laws necessary for the mathematical theory of a large part of physics and the whole of chemistry are thus completely known, and the difficulty is only that the exact application of these laws leads to equations much too complicated to be soluble.”

• Crucial since V(q) determines the quality of result.

• In this lecture we will use semi-empirical potentials: potential is constructed on theoretical grounds but using some experimental data.

• Common examples are Lennard-Jones, Coulomb, embedded atom potentials. They are only good for simple materials. We will not discuss these potentials for reasons of time.

• The ab initio philosophy is that potentials are to be determined directly from quantum mechanics as needed.

• But computer power is not yet adequate in general.

• A powerful approach is to use simulations at one level to determine parameters at the next level.

D. Ceperley Simulation Methods

Statistical Ensembles complete. The underlying physical laws necessary for the mathematical theory of a large part of physics and the whole of chemistry are thus completely known, and the difficulty is only that the exact application of these laws leads to equations much too complicated to be soluble.”

• Classical phase space is 6N variables (pi, qi) and a Hamiltonian function H(q,p,t).

• We may know a few constants of motion such as energy, number of particles, volume...

• Ergodic hypothesis: each state consistent with our knowledge is equally “likely”; the microcanonical ensemble.

• Implies the average value does not depend on initial conditions.

• A system in contact with a heat bath at temperature T will be distributed according to the canonical ensemble:

exp(-H(q,p)/kBT )/Z

• The momentum integrals can be performed.

• Are systems in nature really ergodic? Not always!

D. Ceperley Simulation Methods

Ergodicity complete. The underlying physical laws necessary for the mathematical theory of a large part of physics and the whole of chemistry are thus completely known, and the difficulty is only that the exact application of these laws leads to equations much too complicated to be soluble.”

• Fermi- Pasta- Ulam “experiment” (1954)

• 1-D anharmonic chain: V= [(q i+1-q i)2+ (q i+1-q i)3]

• The system was started out with energy with the lowest energy mode. Equipartition would imply that the energy would flow into the other modes.

• Systems at low temperatures never come into equilibrium. The energy sloshes back and forth between various modes forever.

• At higher temperature many-dimensional systems become ergodic.

• Area of non-linear dynamics devoted to these questions.

D. Ceperley Simulation Methods

Let us say here that the results of our computations were, from the beginning, surprising us. Instead of a continuous flow of energy from the first mode to the higher modes, all of the problems show an entirely different behavior. … Instead of a gradual increase of all the higher modes, the energy is exchanged, essentially, among only a certain few. It is, therefore, very hard to observe the rate of “thermalization” or mixing in our problem, and this wa s the initial purpose of the calculation.

Fermi, Pasta, Ulam (1954)

D. Ceperley Simulation Methods

• Equivalent to exponential divergence of trajectories, or sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

• What we mean by ergodic is that after some interval of time the system is any state of the system is possible.

• Example: shuffle a card deck 10 times. Any of the 52! arrangements could occur with equal frequency.

• Aside from these mathematical questions, there is always a practical question of convergence. How do you judge if your results converged? There is no sure way. Why? Only “experimental” tests.

• Occasionally do very long runs.

• Use different starting conditions.

• Shake up the system.

• Compare to experiment.

D. Ceperley Simulation Methods

Statistical ensembles sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

• (E, V, N) microcanonical, constant volume

• (T, V, N) canonical, constant volume

• (T, P N) constant pressure

• (T, V , ) grand canonical

• Which is best? It depends on:

• the question you are asking

• the simulation method: MC or MD (MC better for phase transitions)

• Lots of work in last 2 decades on various ensembles.

D. Ceperley Simulation Methods

Definition of Simulation sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

• What is a simulation?

An internal state “S”

A rule for changing the state Sn+1 = T (Sn)

We repeat the iteration many time.

• Simulations can be

• Deterministic (e.g. Newton’s equations=MD)

• Stochastic (Monte Carlo, Brownian motion,…)

• Typically they are ergodic: there is a correlation time T. for times much longer than that, all non-conserved properties are close to their average value. Used for:

• Warm up period

• To get independent samples for computing errors.

D. Ceperley Simulation Methods

Problems with estimating errors sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

• Any good simulation quotes systematic and statistical errors for anything important.

• Central limit theorem: after “enough” averaging, any statistical quantity approaches a normal distribution.

• One standard deviation means 2/3 of the time the correct answer is within  of the estimate.

• Problem in simulations is that data is correlated in time. It takes a “correlation” time to be “ergodic”

• We must throw away the initial transient and block successive parts to estimate the mean value and error.

• The error and mean are simultaneously determined from the data. We need at least 20 independent data points.

D. Ceperley Simulation Methods

Estimating Errors sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

• Trace of A(t):

• Equilibration time.

• Histogramof values of A ( P(A) ).

• Meanof A (a).

• Variance of A ( v ).

• estimate of the mean: A(t)/N

• estimate of the variance,

• Autocorrelation of A (C(t)).

• Correlation time (k ).

• The (estimated)error of the (estimated) mean(s ).

• Efficiency [= 1/(CPU time * error 2)]

D. Ceperley Simulation Methods

Data Spork sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

Interactive code to perform statistical analysis of data

Shumway, Draeger,Ceperley

D. Ceperley Simulation Methods

Statistical thinking is slippery sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

• “Shouldn’t the energy settle down to a constant”

• NO. It fluctuates forever. It is the overall mean which converges.

• “My procedure is too complicated to compute errors”

• NO. Run your whole code 10 times and compute the mean and variance from the different runs

• “The cumulative energy has converged”.

• BEWARE. Even pathological cases have smooth cumulative energy curves.

• “Data set A differs from B by 2 error bars. Therefore it must be different”.

• This is normal in 1 out of 10 cases.

D. Ceperley Simulation Methods

Molecular Dynamics: sensitivity to initial conditions. (This is a blessing for numerical work. Why?)Lecture 2

• What to choose in an integrator

• The Verlet algorithm

• Boundary Conditions in Space and time

• Neighbor tables

• Long ranged interactions

• Thermostats

• Constraints

D. Ceperley Simulation Methods

Criteria for an Integrator sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

• simplicity (How long does it take to write and debug?)

• efficiency (How fast to advance a given system?)

• stability (what is the long-term energy conservation?)

• reliability (Can it handle a variety of temperatures, densities, potentials?)

• compare statistical errors (going as h-1/2 ) with time step errors which go as hp where p=2,3...?

D. Ceperley Simulation Methods

Characteristics of simulations. sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

• Potentials are highly non-linear with discontinuous higher derivatives either at the origin or at the box edge.

• Small changes in accuracy lead to totally different trajectories. (the mixing or ergodic property)

• We need low accuracy because the potentials are not very realistic. Universality saves us: a badly integrated system is probably similar to our original system. This is not true in the field of non-linear dynamics or, in studying the solar system

• CPU time is totally dominated by the calculation of forces.

• Memory limits are not too important.

• Energy conservation is important; roughly equivalent to time-reversal invariance.: allow 0.01kT fluctuation in the total energy.

D. Ceperley Simulation Methods

The Verlet Algorithm sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

The nearly universal choice for an integrator is the Verlet (leapfrog) algorithm

r(t+h) = r(t) + v(t) h + 1/2 a(t) h2 + b(t) h3 + O(h4) Taylor expand

r(t-h) = r(t) - v(t) h + 1/2 a(t) h2 - b(t) h3 + O(h4) Reverse time

r(t+h) = 2 r(t) - r(t-h) + a(t) h2 + O(h4) Add

v(t) = (r(t+h) - r(t-h))/(2h) + O(h2) estimate velocities

Time reversal invariance is built in the energy does not drift.

8

1

2

3

4

5

6

7

9

10

11

12

13

D. Ceperley Simulation Methods

How to set the time step sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

• Adjust to get energy conservation to 1% of kinetic energy.

• Even if errors are large, you are close to the exact trajectory of a nearby physical system with a different potential.

• Since we don’t really know the potential surface that accurately, this is satisfactory.

• Leapfrog algorithm has a problem with round-off error.

• Use the equivalent velocity Verlet instead:

r(t+h) = r(t) +h [ v(t) +(h/2) a(t)]

v(t+h/2) = v(t)+(h/2) a(t)

v(t+h)=v(t+h/2) + (h/2) a(t+h)

D. Ceperley Simulation Methods

Higher Order Methods? sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

Statistical error for fixed CPU time.

• Higher order does not mean better

• Problem is that potentials are not analytic

• Systematic errors

• study from Berendsen 86

D. Ceperley Simulation Methods

Spatial Boundary Conditions sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

Important because spatial scales are limited. What can we choose?

• No boundaries; e.g. droplet, protein in vacuum. If droplet has 1 million atoms and surface layer is 5 atoms thick 25% of atoms are on the surface.

• Periodic Boundaries: most popular choice because there are no surfaces (see next slide) but there can still be problems.

• Simulations on a sphere

• External potentials

• Mixed boundaries (e.g. infinite in z, periodic in x and y)

D. Ceperley Simulation Methods

Periodic Boundary Conditions sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

Is the system periodic or just an infinite array of images?

How do you calculate distances in a periodic system?

D. Ceperley Simulation Methods

Periodic distances sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

Minimum Image Convention: take the closest distance:|r|M = min ( r+nL)

• Potential is cutoff so that V(r)=0 for r>L/2 since force needs to be continuous. How about the derivative?

• Image potential

VI =  v(ri-rj+nL)

• For long range potential this leads to the Ewald image potential. You need a back ground and convergence method (more later)

-L -L/2 0 L/2 L

x

D. Ceperley Simulation Methods

Complexity of Force Calculations sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

• Complexity is defined as how a computer algorithm scales with the number of degrees of freedom (particles)

• Number of terms in pair potential is N(N-1)/2  O(N2)

• For short range potential you can use neighbor tables to reduce it to O(N)

• (Verlet) neighbor list for systems that move slowly

• bin sort list (map system onto a mesh and find neighbors from the mesh table)

• Long range potentials with Ewald sums are O(N3/2) but Fast Multipole Algorithms are O(N) for very large N.

D. Ceperley Simulation Methods

! Loop over all pairs of atoms. sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

do i=2,natoms

do j=1,i-1

!Compute distance between i and j.

r2 = 0

do k=1,ndim

dx(k) = r(k,i) - r(k,j)

!Periodic boundary conditions.

if(dx(k).gt. ell2(k)) dx(k) = dx(k)-ell(k)

if(dx(k).lt.-ell2(k)) dx(k) = dx(k)+ell(k)

r2 = r2 + dx(k)*dx(k)

enddo

!Only compute for pairs inside radial cutoff.

if(r2.lt.rcut2) then

r2i=sigma2/r2

r6i=r2i*r2i*r2i

!Shifted Lennard-Jones potential.

pot = pot+eps4*ri6*(ri6-1)- potcut

rforce = eps24*r6i*r2i*(2*r6i-1)

do k = 1 , ndim

force(k,i)=force(k,i) + rforce*dx(k)

force(k,j)=force(k,j) - rforce*dx(k)

enddo

endif

enddo

enddo

LJ Force Computation

D. Ceperley Simulation Methods

Constant Temperature MD sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

• Problem in MD is how to control the temperature. (BC in time.)

• How to start the system? (sample velocities from a Gaussian distribution) If we start from a perfect lattice as the system becomes disordered it will suck up the kinetic energy and cool down. (v.v for starting from a gas)

• QUENCH method. Run for a while, compute kinetic energy, then rescale the momentum to correct temperature, repeat as needed.

• Nose-Hoover Thermostat controls the temperature automatically by coupling the microcanonical system to a heat bath

• Methods have non-physical dynamics since they do not respect locality of interactions. Such effects are O(1/N)

D. Ceperley Simulation Methods

Quench method sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

• Run for a while, compute kinetic energy, then rescale the momentum to correct temperature, repeat as needed.

• Control is at best O(1/N)

D. Ceperley Simulation Methods

Nose-Hoover thermostat sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

• MD in canonical distribution (TVN)

• Introduce a friction force (t)

SYSTEM

T Reservoir

Dynamics of friction coefficient to get canonical ensemble.

Feedback restores makes kinetic energy=temperature

Q= “heat bath mass”. Large Q is weak coupling

D. Ceperley Simulation Methods

Effect of thermostat sensitivity to initial conditions. (This is a blessing for numerical work. Why?)

System temperature fluctuates but how quickly?

Q=1

Q=100

DIMENSION 3

TYPE argon 256 48.

POTENTIAL argon argon 1 1. 1. 2.5

DENSITY 1.05

TEMPERATURE 1.15

TABLE_LENGTH 10000

LATTICE 4 4 4 4

SEED 10

WRITE_SCALARS 25

NOSE 100.

RUN MD 2200 .05

D. Ceperley Simulation Methods

• Thermostats are needed in non-equilibrium situations where there might be a flux of energy in or out of the system.

• It is time reversable, deterministic and goes to the canonical distribution but:

• How natural is the thermostat?

• Interactions are non-local. They propagate instantaneously

• Interaction with a single heat bath variable-dynamics can be strange. Be careful to adjust the “mass”

REFERENCES

• S. Nose, J. Chem. Phys. 81, 511 (1984); Mol. Phys. 52, 255 (1984).

• W. Hoover, Phys. Rev. A31, 1695 (1985).

D. Ceperley Simulation Methods

TPN there might be a flux of energy in or out of the system.

Constant Pressure

• To generalize MD, follow similar procedure as for the thermostat for constant pressure. The size of the box is coupled to the internal pressure

• Volume is coupled to virial pressure

• Unit cell shape can also change.

D. Ceperley Simulation Methods

Parrinello-Rahman simulation there might be a flux of energy in or out of the system.

• 500 KCl ions at 300K

• First P=0

• Then P=44kB

• System spontaneously changes from rocksalt to CsCl structure

D. Ceperley Simulation Methods

• Can “automatically” find new crystal structures there might be a flux of energy in or out of the system.

• Nice feature is that the boundaries are flexible

• But one is not guaranteed to get out of local minimum

• One can get the wrong answer. Careful free energy calculations are needed to establish stable structure.

• All such methods have non-physical dynamics since they do not respect locality of interactions.

• Non-physical effects are O(1/N)

REFERENCES

• H. C. Andersen, J. Chem. Phys. 72, 2384 (1980).

• M. Parrinello and A. Rahman, J. Appl. Phys. 52, 7158 (1981).

D. Ceperley Simulation Methods

Constraints in MD there might be a flux of energy in or out of the system.

• Some problems require constraints:

• fixed bond length (water molecule). We would like to get rid of high frequency motion (not interesting)

• In LDA-MD we need to keep wavefunctions orthogonal.

• Putting constraints in “by hand” is difficult (for example, working in polar coordinates)

• WARNING: constraints change the ensemble.

• SHAKE algorithm lets dynamics move forward without constraint; then forces it back to satisfy the constraint.

• Let equation for constraint be: (R) =0

• Bond constraint is (R) =|r i -r j|2 - a2

D. Ceperley Simulation Methods

• Add Lagrange multiplier there might be a flux of energy in or out of the system. (t)Equation of motion is :

• m a(t) = F - (t) (R,t)

• Using leapfrog method:

• R(t+h) =2R(t)-R(t-h) +h2 F(t)/m - h2(t) (R,t)

• What should we use for (t)?

• Newton’s method so that (R(t+h))=0.

• Iterate until convergence.

• With many constraints: cycle through constraint equations.

d

D. Ceperley Simulation Methods

Brownian dynamics there might be a flux of energy in or out of the system.

• Put a system in contact with a heat bath

• Will discuss how to do this later.

• Not necessarily a bad thing, but requires some physical insight into how the bath interacts with the system in question.

• For example, this is appropriate for a large molecule (protein or colloid) in contact with a solvent. Other heat baths in nature are given by phonons and photons,…

D. Ceperley Simulation Methods

Monitoring the simulation there might be a flux of energy in or out of the system.

• Static properties: pressure, specific heat etc.

• Density

• Pair correlation in real space and fourier space.

• Order parameters: How to tell a liquid from a solid

D. Ceperley Simulation Methods

Thermodynamic properties there might be a flux of energy in or out of the system.

• Internal energy=kinetic energy + potential energy

• Kinetic energy is kT/2 per momentum

• Specific heat = mean squared fluctuation in energy

• pressure can be computed from the virial theorem.

• compressibility, bulk modulus, sound speed

• But we have problems for the basic quantities of entropy and free energy since they are not ratios with respect to the Boltzmann distribution. We will discuss this later.

D. Ceperley Simulation Methods

D. Ceperley Simulation Methods there might be a flux of energy in or out of the system.

Microscopic Density there might be a flux of energy in or out of the system.

(r) = < i (r-r i) >

Or you can take its Fourier Transform:

k = < i exp(ikri) >

(This is a good way to smooth the density.)

• A solid has broken symmetry (order parameter). The density is not constant.

• At a liquid-gas transition the density is also inhomgeneous.

• In periodic boundary conditions the k-vectors are on a grid: k=2/L (nx,ny,nz)Long wave length modes are absent.

• In a solid Lindemann’s ratio gives a rough idea of melting:

u2= <(ri-zi)2>/d2

D. Ceperley Simulation Methods

Order parameters there might be a flux of energy in or out of the system.

• A system has certain symmetries: translation invariance.

• At high temperatures one expect the system to have those same symmetries at the microscopic scale. (e.g. a gas)

• BUT as the system cools those symmetries are broken. (a gas condenses).

• At a liquid gas-transition the density is no longer fixed: droplets form. The density is the order parameter.

• At a liquid-solid transition, both rotational symmetry and translational symmetry are broken

• The best way to monitor the transition is to look for the dynamics of the order parameter.

D. Ceperley Simulation Methods

D. Ceperley Simulation Methods there might be a flux of energy in or out of the system.

Electron Density during exchange there might be a flux of energy in or out of the system. 2d Wigner crystal (quantum)

D. Ceperley Simulation Methods

Snapshots of densities there might be a flux of energy in or out of the system.

Liquid or crystal or glass? Blue spots are defects

D. Ceperley Simulation Methods

Density distribution within a helium droplet there might be a flux of energy in or out of the system.

During addition of molecule, it travels from the surface to the interior.

Red is high density, blue low density of helium

D. Ceperley Simulation Methods

Pair Correlation Function, g(r) there might be a flux of energy in or out of the system.

Primary quantity in a liquid is the probability distribution of pairs of particles. Given a particle at the origin what is the density of surrounding particles

g(r) = < i<j  (ri-rj-r)> (2 /N2)

Density-density correlation

Related to thermodynamic properties.

D. Ceperley Simulation Methods

g(r) in liquid and solid helium there might be a flux of energy in or out of the system.

• First peak is at inter-particle spacing. (shell around the particle)

• goes out to r<L/2 in periodic boundary conditions.

D. Ceperley Simulation Methods

(The static) Structure Factor S(K) there might be a flux of energy in or out of the system.

• The Fourier transform of the pair correlation function is the structure factor

S(k) = <|k|2>/N (1)

S(k) = 1 + dr exp(ikr) (g(r)-1) (2)

• problem with (2) is to extend g(r) to infinity

• This is what is measured in neutron and X-Ray scattering experiments.

• Can provide a direct test of the assumed potential.

• Used to see the state of a system:

liquid, solid, glass, gas? (much better than g(r) )

• Order parameter in solid is G

D. Ceperley Simulation Methods

• In a perfect lattice S(k) will be non-zero only on the reciprocal lattice vectors G: S(G) = N

• At non-zero temperature (or for a quantum system) this structure factor is reduced by the Debye-Waller factor

S(G) = 1+ (N-1)exp(-G2u2/3)

• To tell a liquid from a crystal we see how S(G) scales as the system is enlarged. In a solid, S(k) will have peaks that scale with the number of atoms.

• The compressibility is given by:

• We can use this is detect the liquid-gas transition since the compressibility should diverge as k approaches 0. (order parameter is density)

D. Ceperley Simulation Methods

Crystal liquid reciprocal lattice vectors G: S(G) = N

D. Ceperley Simulation Methods

Here is a snapshot of a binary mixture. What correlation function would be important?

D. Ceperley Simulation Methods

• In a perfect lattice S(k) will be non-zero only on the reciprocal lattice vectors: S(G) = N

• At non-zero temperature (or for a quantum system) this structure factor is reduced by the Debye-Waller factor

S(G) = 1+ (N-1)exp(-G2u2/3)

• To tell a liquid from a crystal we see how S(G) scales as the system is enlarged. In a solid, S(k) will have peaks that scale with the number of atoms.

• The compressibility is given by:

We can use this is detect the liquid gas transition since the compressibility should diverge. (order parameter is density)

D. Ceperley Simulation Methods

Dynamical Properties reciprocal lattice vectors: S(G) = N

• Fluctuation-Dissipation theorem:

HereA e-iwt is a perturbation and (w) e-iwt is the response of B. We calculate the average on the lhs in equilibrium (no external perturbation).

• Fluctuations we see in equilibrium are equivalent to how a non-equilibrium system approaches equilibrium. (Onsager regression hypothesis)

• Density-Density response function is S(k,w) can be measured by scattering and is sensitive to collective motions.

D. Ceperley Simulation Methods

Diffusion Constant reciprocal lattice vectors: S(G) = N

• Diffusion constant is defined by Fick’s law and controls how systems mix

• Microscopically we calculate:

• Alder-Wainwright discovered long-time tails on the velocity autocorrelation function so that the diffusion constant does not exist in 2D

D. Ceperley Simulation Methods

Mixture simulation with CLAMPS reciprocal lattice vectors: S(G) = N

Initial condition Later

D. Ceperley Simulation Methods

Transport Coefficients reciprocal lattice vectors: S(G) = N

• Diffusion: Particle flux

• Viscosity: Stress tensor

• Heat transport: energy current

• Electrical Conductivity: electrical current

These can also be evaluated with non-equilibrium simulations use thermostats to control.

• Impose a shear flow

• Impose a heat flow

D. Ceperley Simulation Methods

CLAMPS input file reciprocal lattice vectors: S(G) = N

TYPE argon 864 48.

POTENTIAL argon argon 1 1. 1. 2.5

DENSITY 0.35

TEMPERATURE 1.418

LATTICE

SEED 10

WRITE_SCALARS 10

WRITE_COORD 20

Setup system

Output intervals

Executes 300 dynamics steps

RUN MD 300 .032

D. Ceperley Simulation Methods

Monte Carlo: reciprocal lattice vectors: S(G) = NLecture 3

• What is Monte Carlo?

• Theory of Markov processes

• Detailed balance and transition rules.

• Grand Canonical and polymer Reptation

• Can Monte Carlo tell us about real dynamics?

• Why Monte Carlo instead of MD?

D. Ceperley Simulation Methods

Monte Carlo reciprocal lattice vectors: S(G) = N

• Invented in Los Alamos in 1944 and named after the famous casino.

• A way of doing integrals by using random numbers:

P(R)=sampling function

Convergence guaranteed by the Central Limit Theorem

• If P(R)f(R) then variance0

• faster way of doing integrals for dimensions > 4

D. Ceperley Simulation Methods

Theory of Markov processes reciprocal lattice vectors: S(G) = N

• Markov process is a random walk through phase space:

s1s2 s3 s4 …

• If it is ergodic, then it will converge to a unique stationary distribution (only one eigenvalue)

• Detailed balance:  (s) P(s s’) =  (s’)P (s’ s ).

Rate balance from s to s’.

• We achieve detailed balance byrejecting moves. Acceptance probability is:

D. Ceperley Simulation Methods

“Classic” Metropolis method reciprocal lattice vectors: S(G) = N

Metropolis Rosenbluth Teller (1953) method:

• Move from s to s’ with probability T(ss’)= constant

• Accept with move with probability:

a(ss’)= min [ 1 , exp ( - (E(s’)-E(s))/kBT ) ]

• Repeat many times

Given ergodicity, the distribution of s will be the canonical distribution: (s) = exp(-E(s)/kBT)/Z

D. Ceperley Simulation Methods

call reciprocal lattice vectors: S(G) = Ninitstate(sold)

vold = action(sold)

LOOP{

callsample(sold,snew,pnew,1)

vnew = action(snew)

call sample(snew,sold,pold,0)

a=exp(-vnew+vold)*pold/pnew if(a.gt.sprng()) {

sold=snew

vold=vnew

naccept=naccept+1}

call averages(sold) }

Initialize the state

Sample snew

Trial action

Find prob. of going backward

Acceptance prob.

Accept the move

Collect statistics

MONTE CARLO CODE

D. Ceperley Simulation Methods

How to sample reciprocal lattice vectors: S(G) = N

Snew = Sold +  (sprng - 0.5)

Uniform distribution in a cube

• It is more efficient to move one particle at a time because only the energy of that particle comes in and the movement and acceptance ratio will be larger.

D. Ceperley Simulation Methods

Monte Carlo Rules reciprocal lattice vectors: S(G) = N

• Optimize the efficiency= error2 (computer time) with respect to any sampling parameters.

• Measure acceptance ratio. Set to roughly1/2 by varying the “step size”

• Accepted and rejected states count the same!

• Exact: no time step error, no ergodic problems in principle but no dynamics.

D. Ceperley Simulation Methods

Optimizing the moves reciprocal lattice vectors: S(G) = N

• Any transition rule is allowed as long as you can go anywhere in phase space with a finite number of them. (ergodic)

• Try to find a T(s  s’)   (s’). If you can the acceptance ratio will be 1.

• We can use the forces to push the walk in the right direction. Taylor expand about the current point.

V(r)=V(r0)-F(r)(r-ro)

• SetT(s  s’)  exp[ -(V(r0)- F(r0)(r-ro))]

• Leads to Force-Bias Monte Carlo

• Related to Brownian motion (Smoluchowski Eq.)

D. Ceperley Simulation Methods

Brownian Dynamics reciprocal lattice vectors: S(G) = N

Consider a big molecule in a solvent. In the high viscosity limit the “master equation” is:

Enforce detailed balance by rejections! (hybrid method)

Also the equation for Diffusion Quantum Monte Carlo!

D. Ceperley Simulation Methods

Other Ensembles in MC reciprocal lattice vectors: S(G) = N

• Monte Carlo can handle discrete and continuous variables at the same time.

• This allows us to treat other ensembles. For example consider the (, V, T) ensemble. The number of particles is variable.

• We consider moves that change the number of particles by adding or subtracting 1 and accepting or rejecting the move.

D. Ceperley Simulation Methods

Free Energy Computation reciprocal lattice vectors: S(G) = N

• Free energy ( and the entropy) is more difficult since ensemble average are of ratios only.

• Special methods are needed: e.g. thermodynamic integration.

Integration path

P

• Find shortest path to known state.

T

D. Ceperley Simulation Methods

Polymer Simulations reciprocal lattice vectors: S(G) = N

• Polymers move very slowly because of entanglement.

• A good algorithm is “reptation” Cut off one end and grow onto the other end.

• Acceptance probability is change in potential

• Simple moves go quickly through polymer space.

• Completely unphysical dynamics or is it? This may be how entangled polymers actually move.

D. Ceperley Simulation Methods

Continuum of Methods reciprocal lattice vectors: S(G) = N

Path Integral Monte Carlo

Ab initio Molecular Dynamics

semi-empirical Molecular Dynamics

Langevin Equation

Brownian Dynamics

Metropolis Monte Carlo

Kinetic Monte Carlo

ACCURATE

FASTER

The general procedure is to average out fast degrees of freedom.

D. Ceperley Simulation Methods

Monte Carlo Dynamics reciprocal lattice vectors: S(G) = N

• MC introduced as a way of sampling configuration space so that MC dynamics is purely fictitious.

• Brownian dynamics and reptation are a model dynamics.

• If we satisfy certain conservation laws in the dynamics (e.g. locality of moves) then the dynamics is a possible model with “local thermodynamic equilibrium” .

• For Ising model we speak of Kawasaki Dynamics- this respects the locality of spin.

• MC dynamics is useful because it is so much faster than MD.

• MC dynamics neglects long time correlations which can arise from hydrodynamical effects.

D. Ceperley Simulation Methods

Comparison between MC and MD reciprocal lattice vectors: S(G) = N Which is better?

• MD can compute dynamics. MC has a kinetics under user control, but dynamics is not necessarily physical. MC dynamics is useful for studying long-term diffusive process.

• MC is simpler: no forces, no time step errors and a direct simulation of the canonical ensemble.

• In MD you can only work on how to make the CPUtime/physical time faster. In MC you can invent better transition rules and ergodicity is less of a problem. MD is sometimes very effective in highly constrained systems.

• MC is more general, it can handle discrete degrees of freedom (e. g. spin models, quantum systems), grand canonical ensemble...

So you need both! The best is to have both in the same code so you can use MC to warm up the dynamics.

D. Ceperley Simulation Methods

“An intelligent being who, at a given moment, knows all the forces that cause nature to move and the positions of the objects that it is made from, if also it is powerful enough to analyze this data, would have described in the same formula the movements of the largest bodies of the universe and those of the lightest atoms. Although scientific research steadily approaches the abilities of this intelligent being, complete prediction will always remain infinitely far away.”

Laplace, 1820

Although detailed predictions may be impossible, is it possible to exactly calculate the properties of materials?

D. Ceperley Simulation Methods