Home WP22: LatticeQCD
WP22: LatticeQCD PDF Print E-mail
Work package number
WP22
Start date
01/01/2009
Activity Type
RTD
Work package acronym
LatticeQCD
Work package title

Lattice Quantum Chromodynamics

 
 
 
 
Beneficiary number
Organization legal name
(in italics the Research Units)
Short name
Activity leaders
(in bold the spokesperson)
Human effort

(person-months)

6
Deutsches Elektronen Synchrotron
DESY
G. Schierholz

61 (61)

1

Istituto Nazionale di Fisica Nucleare

INFN
 
10 (160)
 
INFN Sezione di Bari
INFN-BA
L. Cosmai
(37)
 
INFN Sezione di Cosenza
INFN-CS
A. Papa
(15)
 
INFN Sezione di Ferrara
INFN-FE
S. Schifano
5 (30)
 
INFN Sezione di Genova
INFN-GE
M. D’Elia
(8)
 

INFN Sezione di Milano Bicocca – Gruppo Collegato di Parma

INFN-MIB
F. Di Renzo
(30)
 
INFN Laboratori Nazionali di Frascati
INFN-LNF
M. Lombardo
5 (15)
 
INFN Sezione di Pisa
INFN-PI
A. Di Giacomo
(11)
 
INFN Sezione di Roma2
INFN-RM2
R. Frezzotti
(6)
 
INFN Sezione di Roma3
INFN-RM3
S. Simula
(8)
3
Karl-Franzens Universitaet Graz
UNIGRAZ
C. Lang
5 (30)
9
Gesellschaft für Schwerionenforschung mbH
GSI
J. Wambach
(45)
10
Technische Universität München
TUM

P. Hägler

(30)
12
Universität Bielefeld
UNIBI

E. Laermann

9 (60)
21

Westfälische Wilhelms Universität Münster

WWU

O. Philipsen

(38)
22

Universität Regensburg

UREG

G. Bali

(60)
23

Bergische Universität Wuppertal

BUW

Z. Fodor

8 (26)
26
Universitat de València
UVEG

V. Gimenez

(7)
29
Centre National de la Recherche Scientifique
CNRS
 
20 (20)
 

CNRS Laboratoire de physique théorique d’Orsay

CNRS/LPT-Orsay
D. Becirevic
20 (20)
33

Foundation Bruno Kessler

FBK
 
(11)
 

European Centre for Theoretical Studies in Nuclear Physics and Related Areas

ECT*
L. Scorzato
(11)
43

The University of Edinburgh

UEDIN

R. Horsley

5 (45)
44

University of Glasgow

UGlasgow

C. McNeile

(15)
45

University of Liverpool

ULiverpool

P. Rakow

5 (49)
46

Swansea University

Swansea

S. Hands

30 (30)

Other involved institutions not receiving EC funds

Activity leaders
Estimated human effort involved in the WP

TU Wien (Austria)

M. Faber

(8)

University of Bern (Switzerland)

P. Hasenfratz

(15)

ETH Zürich (Switzerland)

P. de Forcrand

(37)

University of Cyprus (Cyprus)

C. Alexandrou

(15)

Humboldt University Berlin (Germany)

M. Müller-Preussker

(6)

University of Leipzig (Germany)

A. Schiller

(8)

Konrad-Zuse-Zentrum für Informationstechnik Berlin (Germany)

H. Stüben

(8)

University of Oulu (Finland)

K. Rummukainen

(30)

Eötvös University Budapest (Hungary)

S. Katz

(8)

Trinity College, University of Dublin (Ireland)

M. Peardon

(23)

NUI Maynooth (Ireland)

J. Skullerud

(7)

Academia Swietokrzyska (Poland)

M. Gazdzicki

(4)

ITEP Moscow (Russia)

M. Polikarpov

(23)

IHEP Protvino (Russia)

V. Bornyakov

(15)

University of Ljubljana (Slovenia)

S. Fajfer

(5)

University of Oxford (United Kingdom)

M. Teper

(11)

University of Southampton (United Kingdom)

C. Sachrajda

(8)

University of Cambridge (United Kingdom)

R. Morgan

(6)

University of Plymouth (United Kingdom)

K. Langfeld

(30)
 
1. OBJECTIVES

Lattice calculations have become an essential tool to realize and exploit the full potential of the European investment in accelerators and detectors. At present, they are the only means to extract exact non perturbative predictions of QCD from first principles with controlled systematic errors. They set the stage for key experiments at the research infrastructures and are crucial for the interpretation of the anticipated experimental results.

Accomplishments over the last 5 years have established the methodology and laid the groundwork for lattice QCD calculations. Since the cost of full QCD computations grows with a large inverse power of the quark mass, initial calculations were restricted to relatively heavy quarks. In order for lattice calculations to reach the needed accuracy requested by the experiments, simulations at physical quark masses and close to the continuum limit are inevitable. To reach this goal, Teraflop/s-scale computing facilities, a unified programming environment, and the pooling of resources are required.

The purpose of this work package is to provide the hardware and software infrastructure necessary for world class lattice QCD research, and to utilize this infrastructure for scientific discovery. It has proven more cost effective to build dedicated computers rather than to make use of general purpose machines. We plan to assemble and operate a computer consisting of a 3-dimensional array of Enhanced Cell BE processors, QPACE (for QCD parallel computer using cell technology), with an aggregate peak performance of more than 416 (208) Teraflop/s in single (double) precision, optimized for lattice QCD calculations. To achieve Petaflop/s performance, and to utilize the full capacity of the next generation of multi-core processors, which will become available in 2009, a more powerful communication network needs to be developed. In preparation for a Petaflop/s system, we plan to build a prototype machine, whose key elements are a high-bandwidth, low-latency network and the Intel 16 core Nehalem processor. Among the applicants are members of the Italian-German-French consortium that designed and built the apeNEXTcomputer, and some of the architects of the QCDOC machine.

For certain thermodynamics calculations, with moderate demand on computer memory and communication, high-end graphic cards (GPUs) promise to be a powerful alternative to massively parallel architectures. The Wuppertal consortium plans to install a cluster consisting of 32 nodes with 2 GPUs each, with a sustained performance of 2 Teraflop/s in single precision.

Altogether, this goal can only be achieved on a cooperative European level. All the efforts can be coordinated in a Joint Research Activity (JRA) in Lattice QCD.

This JRA will pioneer the design of massively parallel capability computers based on multi-core processors. The QPACE development project includes various Universities and Research Laboratories in Germany and Italy, all of which are participants in this activity, as well as the IBM Böblingen Research Laboratory as industrial partner. The development costs of QPACE, which are substantial, will be defrayed by IBM and Deutsche Forschungsgemeinschaft (DFG) through the Sonderforschungsbereich/Transregio TR55 “Hadron Physics from Lattice QCD”. While QPACE is based on current technology, the prototype machine will utilize the next generation of network hardware and multi-core processors. The advantage of custom built machines is that they provide an unprecedented price-performance ratio.

The QPACE project is well advanced, and the full machine will be installed in Q2. The task then is to exploit it in a real production environment, and to utilize it for research in lattice QCD. The prototype computer will be installed by Q18. Upon successful operation of it, a larger system is envisaged. The effort of making such new technology usable for research and, eventually, commercial applications, is often underestimated. This JRA will bridge the gap.

It will also pioneer the use of high-end graphic cards, like Nvidia 8800, for high-power computing (HPC). It is expected that the gathered experience will be very useful for other groups and other applications with large demand of computer power.

 
2. DESCRIPTION OF WORK AND ROLE OF PARTICIPANTS

The project is organized into 11 main topics. Some of them cover the assembling, testing and operating of the prototype machine and of the graphic cards, while the others concern the physics problems to be studied:

-          Hardware deployment;

-          Machine and application software;

-          Generation of background field configurations;

-          Chiral dynamics;

-          Light hadron spectrum;

-          Hadron structure;

-          Heavy quark physics;

-          Fundamental questions and other directions;

-          Bulk thermodynamics;

-          In-medium hadrons and screening;

-          Universality, Chirality and the hot QCD vacuum.

 

These topics are subdivided into several tasks, which are assigned to and shared among the various participants according to their expertise and manpower. This is shown in the following table.

Institution
Tasks
DESY & NIC

Hardware deployment, operation of prototype machine, machine & application software, generation of background field configurations, hadron structure, B physics, CP violation, bulk thermodynamics

HU Berlin
Algorithms, QCD vacuum
U Leipzig
OPE & renormalization
TU München
Chiral dynamics, hadron structure
U Regensburg

Hardware deployment, machine & application software, hadron spectrum & structure, resonances, universality

ZIB Berlin
Application software, data storage
ITEP Moscow
Hadron form factors, QCD vacuum
IHEP Protvino
QCD vacuum
U Edinburgh

Application software, algorithms, generation of background field configurations, hadron spectrum & structure

U Oxford
Hadron spectrum, large Nc
U Southampton
Hadron structure
U Graz

Hadron spectrum, in-medium modifications, universality

U Bern
Hadron spectrum
U Cyprus
Hadron structure, renormalization
TU Wien
Heavy quark physics, QCD vacuum
U Liverpool

Chiral dynamics, hadron spectrum & structure, resonances

U Cambridge
Lattice perturbation theory
U Glasgow
Hadron spectrum, disconnected diagrams
LPT Orsay
Hadron spectrum, B physics
U Ljubljana
Hadron spectrum
CPT Marseille
Chiral dynamics, hadron spectrum, B physics
U Valencia
Chiral dynamics, B physics
INFN-MIB (PR)
OPE & renormalization
INFN-FE
Hardware deployment, machine software
INFN-Roma 2
Chiral dynamics, B physics
INFN-Roma 3
B physics, CP violation
INFN-PI
Phase diagram, universality, QCD vacuum
INFN-BA
Phase diagram, universality, QCD vacuum
INFN-GE
Bulk thermodynamics, universality
INFN-LNF

Bulk thermodynamics, universality, in-medium modifications

INFN-CS
Bulk thermodynamics, universality
U Bielefeld

Bulk thermodynamics, in-medium modifications, universality, effective theories, application software

U Münster
Bulk thermodynamics, universality
U Oulu
Equation of state
GSI Darmstadt
Bulk thermodynamics, in-medium modifications
ETH Zürich
Bulk thermodynamics, universality
ECT* Trento

Hadron spectrum, renormalization, chiral thermodynamics

U Swansea

Bulk thermodynamics, in-medium modifications, heavy quarks

U Plymouth
Universality, QCD vacuum
TC Dublin
In-medium modifications, heavy quarks
NUI Maynooth
In-medium modifications, heavy quarks
U Wuppertal

Hardware deployment, operation of GPU cluster, bulk thermodynamics

Eötvös U Budapest
Machine & application software
A Swietokrzyska
Bulk thermodynamics
 
Tasks leaders are given hereafter.
Tasks
Task Leaders
Hardware deployment

D. Pleiter (DESY), T. Wettig (Regensburg)

System software

H. Simma (DESY), F. Schifano (Ferrara)

Application software
T. Lippert (NIC Jülich)
Algorithms
A. Kennedy (Edinburgh)
Generation of background configurations
R. Horsley (Edinburgh)
Low-energy constants
S. Dürr (NIC Jülich)
Quark masses & ΛQCD
L. Lellouch (Marseille)
Excited baryons
C. Lang (Graz)
Glueballs & hybrids
C. Michael (Liverpool)
Charmonium & D mesons
G. Bali (Regensburg)
Resonances
P. Rakow (Liverpool)
OPE & renormalization
F. Di Renzo (Parma)
Distribution amplitudes
V. Braun (Regensburg)
Hadron form factors
C. Alexandrou (Cyprus)
Spin & transversity
P. Hägler (München)
GPDs
G. Schierholz (DESY)
Disconnected diagrams
C. McNeile (Glasgow)
B physics
D. Becirevic (Paris)
QCD vacuum
M. Polikarpov (ITEP)
CP violation
S. Simula (Roma III)
Large Nc
M. Teper (Oxford)
QCD phase diagram
O. Philipsen (Münster)
Equation of State
F. Karsch (Bielefeld)
Fluctuations and correlations
M. Lombardo (Frascati)
Thermodynamics on GPUs
Z. Fodor (Wuppertal)
Spectral properties
S. Hands (Swansea)
Screening phenomena
E. Laermann (Bielefeld)
Universal aspects
A. Di Giacomo (Pisa)
Hot QCD vacuum

M. Müller-Preussker (HU Berlin)

Chiral thermodynamics
C. Gattringer (Graz)
 
3. DELIVERABLES

The QPACE machine will enable calculation of the physical observables at pion masses down to 140 MeV and lattice spacings down to 0.05 fm on spatial volumes larger or equal to (4 fm)3 with high statistics. Combined with chiral perturbation theory, controlled extrapolation in pion mass, lattice volume and lattice spacing will be possible.

 
The main deliverables will be:
  • Operational prototype of a GPU-based computer (delivery month from start date: 12),
  • Operational 416 Teraflop/s QPACE computer (delivery month from start date:6)
  • Operational prototype of a next generation multi-core processor machine (delivery month from start date:18)
  • Operational software and libraries for the next generation machine (delivery month from start date:24),
  • Physics results and publications (delivery month from start date:30);

A large number of physics results and publications, following the tasks defined here above, are anticipated.

 
4. EXPECTED IMPACT

Lattice QCD, like other areas of science, is limited by computer performance. In the long run it will demand sustained speeds of Petaflop/s or more. This presents a greater challenge than the recent step to Teraflop/s, because massive parallelism must be delivered at an affordable price, and many codes running on present systems will not scale up to run efficiently on ten to hundred times more processors or cores. Hardware that is tailored to the application, and/or serendipitous use of cheap commodity parts developed for some other purpose, will be needed to keep machine costs down, and software will need to be re-engineered to use it efficiently. These factors are driving us towards a diversity of architectures, international facilities and community code bases. There is scope for innovative solutions, which gives Europe the opportunity to re-enter the high-performance computing arena. We believe that a multi-core processor based parallel system provides a particularly promising solution.

This JRA will strengthen existing capabilities and the development of new high-performance computing competence in Europe. It will enable the JSC-Jülich and ZIB-Berlin Computing Centres, as well as DESY, to provide truly European service to the wider hadron physics community. Furthermore, our combined efforts in testing, writing and disseminating optimized scientific codes will contribute significantly to the quality and performance of the European computational infrastructure. Participation in this project will also have a significant training benefit.

Last, but not least, this joint effort will give us complete control over the systematic errors inherent in the numerical calculations, thus providing a unique opportunity for a fruitful synergy between lattice gauge theory and the research infrastructures CERN, DESY, FZ-Jülich, GSI, JLab, LNF-Frascati and MAMI, as well as JSC and ZIB.

The outcome of this project is a highly innovative HPC hardware and software infrastructure, which exploits the potential of multi-core architectures such as the Cell BE processor and its successors and GPUs, with ready-to-go machine and application software, as well as the research infrastructure necessary to capitalize on this opportunity.