109 |
from the Matlab prompt (there are no parameters to pass) generates |
from the Matlab prompt (there are no parameters to pass) generates |
110 |
exch2 topology files \file{W2\_EXCH2\_TOPOLOGY.h} and |
exch2 topology files \file{W2\_EXCH2\_TOPOLOGY.h} and |
111 |
\file{w2\_e2setup.F} in the working directory and displays a figure of |
\file{w2\_e2setup.F} in the working directory and displays a figure of |
112 |
the topology via Matlab -- figures \ref{fig:6tile}, \ref{fig:12tile}, |
the topology via Matlab -- figures \ref{fig:6tile}, \ref{fig:18tile}, |
113 |
and \ref{fig:24tile} are examples of the generated diagrams. The other |
and \ref{fig:48tile} are examples of the generated diagrams. The other |
114 |
m-files in the directory are |
m-files in the directory are |
115 |
subroutines called from \file{driver.m} and should not be run ``bare'' except |
subroutines called from \file{driver.m} and should not be run ``bare'' except |
116 |
for development purposes. \\ |
for development purposes. \\ |
131 |
the tiles into which the subdomains are decomposed, and must evenly |
the tiles into which the subdomains are decomposed, and must evenly |
132 |
divide the integer assigned to \code{nr}, \code{nb} and \code{ng}. |
divide the integer assigned to \code{nr}, \code{nb} and \code{ng}. |
133 |
The result is a rectangular tiling of the subdomain. Figure |
The result is a rectangular tiling of the subdomain. Figure |
134 |
\ref{fig:24tile} shows one possible topology for a twenty-four-tile |
\ref{fig:48tile} shows one possible topology for a twenty-four-tile |
135 |
cube, and figure \ref{fig:12tile} shows one for twelve tiles. \\ |
cube, and figure \ref{fig:6tile} shows one for six tiles. \\ |
136 |
|
|
137 |
\begin{figure} |
\begin{figure} |
138 |
\begin{center} |
\begin{center} |
139 |
\resizebox{4in}{!}{ |
\resizebox{6in}{!}{ |
140 |
\includegraphics{part6/s24t_16x16.ps} |
% \includegraphics{part6/s24t_16x16.ps} |
141 |
|
\includegraphics{part6/adjust_cs.ps} |
142 |
} |
} |
143 |
\end{center} |
\end{center} |
144 |
|
|
145 |
\caption{Plot of a cubed sphere topology with a 32$\times$192 domain |
\caption{Plot of a cubed sphere topology with a 32$\times$192 domain |
146 |
divided into six 32$\times$32 subdomains, each of which is divided |
divided into six 32$\times$32 subdomains, each of which is divided |
147 |
into four tiles of width \code{tnx=16} and height \code{tny=16} for a |
into eight tiles of width \code{tnx=16} and height \code{tny=8} for a |
148 |
total of twenty-four tiles. The colored borders of the subdomains |
total of forty-eight tiles. The colored borders of the subdomains |
149 |
represent the parameters \code{nr} (red), \code{nb} (blue), and |
represent the parameters \code{nr} (red), \code{ng} (green), and |
150 |
\code{ng} (green). } \label{fig:24tile} |
\code{nb} (blue). |
151 |
|
This tiling is used in the example |
152 |
|
verification/adjustment.cs-32x32x1/ |
153 |
|
with the option (blanklist.txt) to remove the land-only 4 tiles |
154 |
|
(11,12,13,14) which are filled in red on the plot. |
155 |
|
} \label{fig:48tile} |
156 |
\end{figure} |
\end{figure} |
157 |
|
|
158 |
\begin{figure} |
\begin{figure} |
159 |
\begin{center} |
\begin{center} |
160 |
\resizebox{4in}{!}{ |
\resizebox{6in}{!}{ |
161 |
\includegraphics{part6/s12t_16x32.ps} |
% \includegraphics{part6/s12t_16x32.ps} |
162 |
|
\includegraphics{part6/polarcap.ps} |
163 |
} |
} |
164 |
\end{center} |
\end{center} |
165 |
\caption{Plot of a cubed sphere topology with a 32$\times$192 domain |
\caption{Plot of a non-square cubed sphere topology with |
166 |
divided into six 32$\times$32 subdomains of two tiles each |
6 subdomains of different size (nr=90,ng=360,nb=90), |
167 |
(\code{tnx=16, tny=32}). |
divided into one to four tiles each |
168 |
} \label{fig:12tile} |
(\code{tnx=90, tny=90}), resulting in a total of 18 tiles. |
169 |
|
} \label{fig:18tile} |
170 |
\end{figure} |
\end{figure} |
171 |
|
|
172 |
\begin{figure} |
\begin{figure} |
173 |
\begin{center} |
\begin{center} |
174 |
\resizebox{4in}{!}{ |
\resizebox{4in}{!}{ |
175 |
|
% \includegraphics{part6/s6t_32x32.ps} |
176 |
\includegraphics{part6/s6t_32x32.ps} |
\includegraphics{part6/s6t_32x32.ps} |
177 |
} |
} |
178 |
\end{center} |
\end{center} |
240 |
processor. Such dummy tiles are \emph{not} listed in |
processor. Such dummy tiles are \emph{not} listed in |
241 |
\file{blanklist.txt}. |
\file{blanklist.txt}. |
242 |
|
|
243 |
The following is an example of \file{SIZE.h} for the twelve-tile |
The following is an example of \file{SIZE.h} for the six-tile |
244 |
configuration illustrated in figure \ref{fig:12tile} running on one |
configuration illustrated in figure \ref{fig:6tile} |
245 |
processor: |
running on one processor: |
246 |
|
|
247 |
\begin{verbatim} |
\begin{verbatim} |
248 |
PARAMETER ( |
PARAMETER ( |
249 |
& sNx = 16, |
& sNx = 32, |
250 |
& sNy = 32, |
& sNy = 32, |
251 |
& OLx = 2, |
& OLx = 2, |
252 |
& OLy = 2, |
& OLy = 2, |
253 |
& nSx = 12, |
& nSx = 6, |
254 |
& nSy = 1, |
& nSy = 1, |
255 |
& nPx = 1, |
& nPx = 1, |
256 |
& nPy = 1, |
& nPy = 1, |
259 |
& Nr = 5) |
& Nr = 5) |
260 |
\end{verbatim} |
\end{verbatim} |
261 |
|
|
262 |
The following is an example for the twenty-four-tile topology in |
The following is an example for the forty-eight-tile topology in |
263 |
figure \ref{fig:24tile} running on six processors: |
figure \ref{fig:48tile} running on six processors: |
264 |
|
|
265 |
\begin{verbatim} |
\begin{verbatim} |
266 |
PARAMETER ( |
PARAMETER ( |
267 |
& sNx = 16, |
& sNx = 16, |
268 |
& sNy = 16, |
& sNy = 8, |
269 |
& OLx = 2, |
& OLx = 2, |
270 |
& OLy = 2, |
& OLy = 2, |
271 |
& nSx = 4, |
& nSx = 8, |
272 |
& nSy = 1, |
& nSy = 1, |
273 |
& nPx = 6, |
& nPx = 6, |
274 |
& nPy = 1, |
& nPy = 1, |
302 |
of tiles in the $x$ and $y$ global indices. For example, the default |
of tiles in the $x$ and $y$ global indices. For example, the default |
303 |
setup of six tiles (Fig. \ref{fig:6tile}) has |
setup of six tiles (Fig. \ref{fig:6tile}) has |
304 |
\code{exch2\_domain\_nxt=6} and \code{exch2\_domain\_nyt=1}. A |
\code{exch2\_domain\_nxt=6} and \code{exch2\_domain\_nyt=1}. A |
305 |
topology of twenty-four square tiles, four per subdomain (as in figure |
topology of forty-eight tiles, eight per subdomain (as in figure |
306 |
\ref{fig:24tile}), will have \code{exch2\_domain\_nxt=12} and |
\ref{fig:48tile}), will have \code{exch2\_domain\_nxt=12} and |
307 |
\code{exch2\_domain\_nyt=2}. Note that these parameters express the |
\code{exch2\_domain\_nyt=4}. Note that these parameters express the |
308 |
tile layout in order to allow global data files that are tile-layout-neutral. |
tile layout in order to allow global data files that are tile-layout-neutral. |
309 |
They have no bearing on the internal storage of the arrays. The tiles |
They have no bearing on the internal storage of the arrays. The tiles |
310 |
are stored internally in a range from \code{\varlink{bi}{bi}=(1:NTILES)} in the |
are stored internally in a range from \code{\varlink{bi}{bi}=(1:NTILES)} in the |
344 |
The array \varlink{exch2\_myFace}{exch2_myFace} contains the number of |
The array \varlink{exch2\_myFace}{exch2_myFace} contains the number of |
345 |
the subdomain of each tile, in a range \code{(1:6)} in the case of the |
the subdomain of each tile, in a range \code{(1:6)} in the case of the |
346 |
standard cube topology and indicated by \textbf{\textsf{f}}$n$ in |
standard cube topology and indicated by \textbf{\textsf{f}}$n$ in |
347 |
figures \ref{fig:12tile} and |
figures \ref{fig:6tile} and |
348 |
\ref{fig:24tile}. \varlink{exch2\_nNeighbours}{exch2_nNeighbours} |
\ref{fig:48tile}. \varlink{exch2\_nNeighbours}{exch2_nNeighbours} |
349 |
contains a count of the neighboring tiles each tile has, and sets |
contains a count of the neighboring tiles each tile has, and sets |
350 |
the bounds for looping over neighboring tiles. |
the bounds for looping over neighboring tiles. |
351 |
\varlink{exch2\_tProc}{exch2_tProc} holds the process rank of each |
\varlink{exch2\_tProc}{exch2_tProc} holds the process rank of each |
467 |
\varlink{exch2\_jthi\_c}{exch2_jthi_c} hold the location and index |
\varlink{exch2\_jthi\_c}{exch2_jthi_c} hold the location and index |
468 |
bounds of the edge segment of the neighbor tile \code{N}'s subdomain |
bounds of the edge segment of the neighbor tile \code{N}'s subdomain |
469 |
that gets exchanged with the local tile \code{T}. To take the example |
that gets exchanged with the local tile \code{T}. To take the example |
470 |
of tile \code{T=2} in the twelve-tile topology |
of tile \code{T=2} in the forty-eight-tile topology |
471 |
(Fig. \ref{fig:12tile}): \\ |
(Fig. \ref{fig:48tile}): \\ |
472 |
|
|
473 |
\begin{verbatim} |
\begin{verbatim} |
474 |
exch2_itlo_c(4,2)=17 |
exch2_itlo_c(4,2)=17 |
538 |
\code{EXCH2\_SEND\_RX1} and \code{EXCH2\_SEND\_RX2}, which do most of |
\code{EXCH2\_SEND\_RX1} and \code{EXCH2\_SEND\_RX2}, which do most of |
539 |
the work using the variables discussed above. \\ |
the work using the variables discussed above. \\ |
540 |
|
|
541 |
|
\subsubsection{Experiments and tutorials that use exch2} |
542 |
|
\label{sec:pkg:exch2:experiments} |
543 |
|
|
544 |
|
\begin{itemize} |
545 |
|
\item{Held Suarez tutorial, in tutorial\_held\_suarez\_cs verification directory, |
546 |
|
described in section \ref{sect:eg-hs} } |
547 |
|
\end{itemize} |