Nephrol Dial Transplant (2003) 18: 769-776
© 2003 European Renal Association-European Dialysis and Transplant Association
Kinetics and dosing predictions for daily haemofiltration
1 Research Service, Salt Lake City VA Health Care System and Departments of Internal Medicine and Bioengineering, University of Utah, Salt Lake City, UT, 2 Division of Nephrology, New England Medical Center, Boston, MA, 3 Department of Biomedical Engineering, Brown University, Providence, RI, 4 Division of Nephrology, Mayo Clinic, Rochester, MN and 5 Vasca, Tewksbury, MA, USA
| Abstract |
|---|
|
|
|---|
Background. Thrice-weekly haemofiltration affords excellent outcome when it is used to treat chronic renal failure patients. Daily haemofiltration (DHF) has recently been proposed as a more intensive therapy option, but the total ultrafiltration or exchange volume (replacement volume plus net ultrafiltration volume) requirements for adequate solute clearances during this novel therapy are unknown.
Methods. We calculated theoretical solute kinetic profiles during six times per week DHF for comparison with those during thrice-weekly haemodialysis using a high-flux dialyser (HFHD) or during continuous ambulatory peritoneal dialysis (CAPD). HFHD and CAPD were chosen for comparison because K/DOQI guidelines have defined adequate treatment doses for these therapies. Steady-state concentrations were calculated using a two-compartment model of an anuric patient with 35 l of total body water for five solutes: urea, creatinine, vitamin B12, inulin and ß2-microglobulin. Solute distribution volumes and generation rates were taken from the literature, and excess fluid (1 l/day) was assumed to accumulate in and be removed from the extracellular fluid compartment. Theoretical predictions of solute clearance were compared for a 15-l exchange volume/session during DHF, urea Kt/V of 3.6/week during HFHD and urea Kt/V of 2.0/week during CAPD as solute-specific values of the equivalent renal clearance (EKR) and standard Kt/V (stdKt/V) recently defined by Gotch. Additional comparisons of solute clearances were performed between DHF and other daily therapies including six times per week short daily haemodialysis (SDHD) and six times per week nocturnal haemodialysis (NHD).
Results. The calculated results predict that: (i) urea clearance during DHF with an exchange volume of 90 l/week (6x15 l) is equivalent to those during HFHD and CAPD based on urea stdKt/V; and (ii) middle molecule clearances during DHF exceed those achieved during HFHD and CAPD based on either EKR or stdKt/V. As expected, DHF therapy was inferior regarding the clearance of urea and other small solutes to SDHD and NHD; however, DHF therapy was superior to SDHD regarding the clearance of larger middle molecules, approaching the clearances achieved by NHD.
Conclusions. We predict that an exchange volume of
40% of total body water (15/35 l=43%) per session will provide adequate clearance of small solutes and substantial clearance of middle molecules during six times per week DHF therapy. These theoretical predictions require clinical validation.
Keywords: daily; dose; haemofiltration; kinetics; Kt/V; urea
| Introduction |
|---|
|
|
|---|
Haemofiltration was developed in the middle 1960s as an alternative to haemodialysis and peritoneal dialysis that would provide solute clearance characteristics more like those of the native kidney [1]. This modality is performed using highly permeable membranes and makes use of convective solute removal; these two characteristics of haemofiltration are also those employed by the native kidney. During haemofiltration, solutes from urea to middle molecules are cleared at the same rate, allowing substantial removal of middle molecules. Patient outcome when using chronic three times per week haemofiltration therapy has been reported to be excellent among many centres throughout the world [2,3].
Despite the advantage of enhanced clearance of middle molecules, haemofiltration is not widely employed to treat patients with chronic renal failure, particularly in North America. Commonly perceived disadvantages of chronic haemofiltration are: the complexity and cost of available equipment and low clearances for small molecular weight toxins using traditional post-dilutional haemofiltration, where 2030 l are exchanged three times per week for 4 h [4]. Regarding the concern over low small solute clearance rates, two possible solutions have been proposed. First, technical innovations, which permit on-line production of ultrapure solutions for direct i.v. infusion have rejuvenated interest in pre-dilutional haemofiltration using large volumes (e.g. 70 l/session, three times per week) of replacement fluid [5]. This approach to chronic haemofiltration therapy promises to provide high solute clearances for both small solutes and middle molecules. Secondly, the daily application of haemofiltration or haemodiafiltration has recently been proposed as a more physiological alternative [6]. The more frequent application of haemofiltration during chronic therapy may provide more efficacious removal of both small solutes and middle molecules; however, the total ultrafiltration or exchange volume required to provide an adequate dose of daily therapy has not been estimated previously.
This report calculates dosing predictions for the exchange volume required for adequate clearances of small solutes and middle molecules during daily haemofiltration (DHF) therapy. These predictions were made using a variable-volume, two-compartment model of solute kinetics that was described previously [7]. Solute clearances were compared during DHF with those during haemodialysis using high-flux dialysers (HFHD) and continuous ambulatory peritoneal dialysis (CAPD) using two dose measures: the equivalent renal clearance (EKR) [8] and the standard Kt/V (stdKt/V) described by Gotch [9]. Solute clearance comparisons were performed for urea as well as other marker molecules of various molecular weights.
| Subjects and methods |
|---|
|
|
|---|
Solute kinetics were simulated theoretically using a variable-volume, two-compartment mathematical model for three different treatment modalities, DHF, haemodialysis using a HFHD and CAPD, to calculate an exchange volume for achieving adequate solute clearances during DHF therapy. Additional, but more limited, comparison was also performed between DHF and other daily therapies including short daily haemodialysis (SDHD) and nocturnal haemodialysis (NHD). Steady-state solute concentration profiles were simulated for five uraemic surrogate solutes with a broad molecular weight spectrum (Table 1
|
The mathematical model allowed for partition of solutes into two different compartments (Figure 1
|
Solute generation was assumed to occur only within the perfused compartment. Endogenous solute generation was assumed to be constant for urea, creatinine and ß2-microglobulin, with generation rates identical to the values assumed by Clark et al. [7] (Table 1
Solute transfer between the compartments was assumed to be proportional to the solute concentration difference; the proportionality constant was defined as the intercompartmental transfer constant or clearance KIC. The values of KIC for each solute were assumed to be identical to those reported previously (Table 1
), and these values were shown previously to predict post-dialysis rebound of solutes similar to those observed experimentally [7].
The rate of fluid removal during DHF, HFHD, SDHD and NHD was assumed constant throughout the treatment. During DHF, the rate of fluid removal was assumed to be equal to the ultrafiltration rate minus the infusion rate of replacement fluid. During HFHD, SDHD and NHD, the rate of fluid removal was assumed to be equal to the ultrafiltration rate. During CAPD, the rate of fluid removal was dependent on the glucose concentration in the dialysate and was assumed to be equal to the time-dependent ultrafiltration rate predicted by the model of Pyle [11] (see Appendix). For each treatment modality, weekly fluid removal was matched to weekly fluid accumulation so that overall patient volume was at steady state. Unless stated otherwise, the rate of fluid intake or accumulation was assumed to be constant and equal to 1 l/day.
Solute removal from the body was evaluated differently for each treatment modality; the details of these relationships are described in the Appendix. During DHF, six identical 2.5-h treatments per week were simulated; 1 day was without any treatment. Solute clearance during DHF therapy was assumed to be proportional to the ultrafiltration rate; the convective permeability factor was the solute sieving coefficient. The solute sieving coefficients during DHF for most calculations in this study were based on reported in vitro measurements conducted with either bovine or human plasma with a protein concentration of 6 mg/dl [12,13]. The assumed values are shown in Table 2
. During HFHD, three 3-h treatments per week were simulated on a traditional Monday/Wednesday/Friday schedule. Solute clearances during HFHD were calculated assuming the use of a HFHD, a blood flow rate of 340 ml/min and a dialysate flow rate of 500 ml/min in order to achieve a single pool urea Kt/V of 1.2/treatment. The dialyser mass transfer-area coefficients for each solute in this study were assumed to be
20% higher than those assumed by Clark et al. [7] and are shown in Table 2
. These values were chosen as a compromise between those assumed by Clark et al. [7] and in vivo mass transfer-area coefficients for urea reported recently for HFHD (T.A. Depner, T. Green, J.T. Daugirdas et al., manuscript submitted for publication). Dialyser solute clearances during HFHD were also adjusted for ultrafiltration (see Appendix). SDHD therapy consisted of six 2.5-h treatments, under identical conditions to those assumed during HFHD, and NHD therapy consisted of six 8-h treatments assuming a HFHD with mass transfer-area coefficients 60% of those described in Table 2
, a blood flow rate of 250 ml/min and a dialysate flow rate of 100 ml/min, conditions reflective of the use of small surface area HFHD and flow rates as reported by Pierratos et al. [14]. Solute clearances during SDHD and NHD were calculated in a similar way to those during HFHD. Five 2-l exchanges per day were simulated during CAPD. Solute transport across the peritoneal membrane was calculated accounting for both diffusive and convective transport (see Appendix). Solute transport rates by diffusion and convection were assumed to be related to the permeability-area product (PA) and the solute reflection coefficient (
), respectively, for the peritoneal membrane; the assumed values of these parameters are listed in Table 2
. Non-renal clearance was assumed to be zero, except for ß2-microglobulin where it was assumed to be 3 ml/min [15].
|
Steady-state solute concentration profiles for each solute were computed by iterative solution of the governing equations (see Appendix) over a 10-week interval. The governing equations were solved by using a variable time-step, fourthfifth order RungeKutta algorithm [16]. From the steady-state concentration profiles, several additional parameters were calculated. The time-averaged concentration (TAC) was obtained for each solute/modality combination as a time- and volume-weighted average of the intradialytic and interdialytic concentrations, assuming these concentrations were linear during the intradialytic, immediate post-dialysis rebound and interdialytic periods as described elsewhere [7]. The immediate post-dialysis rebound period was assumed to be 1 h for urea, creatinine and vitamin B12, and 4 h for inulin and ß2-microglobulin. TACs for the intradialytic and interdialytic solute concentration profiles were first calculated for the perfused and non-perfused compartments separately; then, the whole body TAC was calculated by averaging the individual compartment TAC values, weighted for the compartment volumes. With the assumed solute generation rate (G) and calculated whole body TAC values known, the EKR was then calculated as described previously [7,8]
|
|
The mean pre-treatment concentration (MPC) was calculated by averaging the pre-treatment concentrations in the perfused compartment. The stdKt/V for each solute was then calculated by the following equation
|
|
| Results |
|---|
|
|
|---|
Solute concentration profiles and dose measures were first calculated for 12, 15 and 18 l of exchange volume during DHF. The solute dose measures (EKR and stdKt/V) increased regularly with increasing exchange volume, as expected (Table 3
|
The effect of treatment time (between 2 and 3 h) during DHF at a constant exchange volume of 15 l on the calculated solute dose measures was small (<3%) for small solutes (i.e. urea and creatinine, Table 4
|
Figure 2
|
Calculated values of TAC and MPCs for the five different solutes during DHF, HFHD and CAPD are shown in Figures 3
|
|
Calculated values of EKR and stdKt/V are shown in Figures 5
|
|
It should be emphasized that the advantage of DHF for clearing large molecules is dependent on the sieving properties of the membrane. If, for example, the sieving coefficients for vitamin B12, inulin and ß2-microglobulin were assumed to be one-half of the values shown in Table 2
All of the above results were calculated assuming a daily fluid intake of 1 l. Table 5
shows the effect of fluid intake on calculated dose measures (EKR and stdKt/V) for urea when the total ultrafiltration or exchange volume was 15 l/day. These calculated results show that at a fixed exchange volume, increases in daily fluid intake result in higher EKR and stdKt/V values for urea due to the dilution of solutes by fluid intake. Note also that the replacement fluid volume required to achieve a given exchange volume decreases with increasing daily fluid intake.
|
Comparisons of solute dose measures (EKR and stdKt/V) between DHF, SDHD and NHD are shown in Figures 7
|
|
| Discussion |
|---|
|
|
|---|
The adequacy of different treatment modalities for end-stage renal disease patients has long been a topic of debate, and several studies continue to explore the optimal dose of therapy for conventional three times per week haemodialysis and continuous peritoneal dialysis. Currently, however, K/DOQI has established generally accepted minimum dosing guidelines for both haemodialysis [17] and peritoneal dialysis [18]. Dosing guidelines for these two therapies are expressed using an indexed clearance of urea, or urea Kt/V. The dosing guidelines suggested by K/DOQI for haemodialysis and peritoneal dialysis are quite different from each other: a weekly urea Kt/V target of 3.6 (3x1.2) for conventional haemodialysis and a weekly urea Kt/V target of 2.0 for CAPD. Nevertheless, these dosing guidelines represent the empirical judgment of the nephrology community based on years of experience with these therapies.
Two different approaches for evaluating the effect of treatment modality on dialysis dose and adequacy are those based on controlling either the time-averaged or the MPCs of urea, instead of urea Kt/V. Casino and Lopez [8] proposed that an adequate dose of dialysis can be assessed using the EKR, and Clark et al. [7] have shown that this parameter, corrected for solute rebound post-dialysis, can be used to evaluate the dose for more frequent or intense haemodialysis therapies. As discussed above, EKR is equivalent between therapies when time-averaged solute concentrations are equal; however, equivalent patient outcomes during haemodialysis and peritoneal dialysis are not achieved at equal values of EKR for urea. Alternatively, Gotch [9] has recently focused on controlling the MPC of urea for assessing the dose of renal replacement therapies. Control of the MPC of urea provides the foundation for Gotch's hypothesis, which proposes that stdKt/V for urea is the best dose measure for comparing treatment modalities and regimens different from thrice-weekly haemodialysis, because this hypothesis supports the relative therapeutic equivalence of CAPD and conventional haemodialysis [9].
The concepts of EKR and stdKt/V are general and not limited to just urea. For example, Clark et al. [7] computed theoretical EKR values for five solutes of differing molecular weight and used this parameter to evaluate the relative efficiencies of different haemodialysis regimens to remove these solutes. In addition, Gotch has recently suggested that the stdKt/V concept should be generalized to other solutes [19]. The current study represents an attempt to compute theoretical values of stdKt/V for solutes other than urea to compare solute clearances for different modalities.
Whether based on calculated values of either EKR or stdKt/V, our comparisons between DHF, HFHD and CAPD, in terms of solute clearance (especially for middle molecules), are rather robust. Our calculated results show that EKR values for small solutes, urea and creatinine, are higher during HFHD than during DHF and CAPD, but the largest EKR values for the middle molecules were calculated during DHF (Figure 5
). This dose measure suggests that HFHD is superior to DHF and CAPD in clearing small solutes but DHF is superior to both HFHD and CAPD in clearing middle molecules, including low molecular weight proteins. Our calculated results for stdKt/V show that DHF, HFHD and CAPD provide approximately equivalent weekly clearances for small solutes such as urea, but DHF is superior to HFHD and CAPD in clearing middle molecules (Figure 6
). Therefore, use of either generalized dose measure shows that clearance of large molecular weight solutes during DHF will be superior to those during both HFHD and CAPD.
Exploration of new therapy modalities has recently received considerable attention; the clinical advantages of more frequent haemodialysis treatments for chronic renal failure patients have recently been reviewed [20]. Several studies have suggested that increasing the frequency and intensity of therapy improves blood pressure control, improves nutritional status and decreases complications requiring hospitalization in chronic haemodialysis patients [20]. Some of these improvements are probably due to the more continuous nature of the therapy, while others are also potentially due to the increased dose, both in terms of small solute and middle molecule clearances. The ability to assess the relative importance of small solute and middle molecule clearances for improving haemodialysis patient outcome is controversial. As a result, dosing guidelines for these therapies are not yet universally defined. Our comparison of solute clearances between DHF and other daily therapies (Figures 7
and 8
) illustrates that diffusion-based (haemodialysis) therapies (SDHD and NHD) provide higher clearances of small solutes. DHF therapy, however, clears more of the larger middle molecules than SDHD; the clearances of middle molecules with DHF approach those achieved by NHD, the therapy that provides the highest clearances for both small solute and middle molecules to date.
DHF also has the potential to improve clinical outcomes vs conventional therapies for chronic renal failure patients. Again, some of the improvements may arise from the daily, more continuous nature of the therapy (as above), but historical experience with chronic haemofiltration therapy suggests that other benefits may arise from the broader, more physiologic clearance profile, which more closely mimics the natural renal glomerulus. Because of these significant differences in the therapy provided, establishing equivalent dosing is made even more complex. The current effort is a first attempt to predict dosing requirements for DHF using generally accepted solute dose measures. Assuming that an stdKt/V for urea of 2.0 defines adequate therapy, this study predicts that the dose of DHF is an exchange volume of
40% of total body water (15/35 l=43%) six times per week. It should be noted that this prediction might be conservative as such a dose of therapy will also provide the additional benefit of enhanced clearances of middle molecules. On the other hand, there is substantial room for improving outcomes for end-stage renal disease patients; thus, it is likely that solute clearance targets may be higher for all renal replacement therapies in the near future. Clearly, further refinement of this and more extensive predictions will require empirical clinical comparisons with treatment outcomes.
Several limitations of this study should be noted. First, we have assumed that no protein binding of solutes occurs. This is likely to be a good assumption for some small solutes, such as urea and creatinine, but may not be realistic for other molecules of interest, especially vitamin B12. Secondly, calculated values of EKR for urea in this study do not achieve the minimum of 11 ml/min as originally proposed by Casino and Lopez [8]. It should be pointed out, however, that Casino and Lopez calculated EKR values assuming that the distribution volume of urea was a single body pool and therefore did not account for post-dialysis urea rebound. Thirdly, the current theoretical predictions assumed a fluid intake of 1 l/day, a value that may be low for some end-stage renal disease patients. Our additional calculations (Table 5
) show, however, that the exchange volume requirements to achieve a given dose of urea removal actually decrease with increasing fluid intake. Fourthly, the ultrafiltration flow rate required to achieve 15 l of ultrafiltration in 2.5 h of 100 ml/min will require high blood flow rates, approaching 500 ml/min. Therefore, it may be necessary to lengthen treatment times for patients with large body weight and those unable to achieve high blood flows without access recirculation. Any lengthening of treatment times at the same exchange volume will only lead to enhanced middle molecule clearances. Previous studies by Canaud and colleagues [21] have reported average ultrafiltration rates of over 125 ml/min during 3-h treatments of daily post-dilution haemofiltration, suggesting that the current predictions are reasonable. Lastly, our theoretical predictions are limited by the accuracy of the assumed transport parameters. For example, differences in peritoneal membrane transport characteristics among patients may yield clinical results different from those predicted here. Similar discrepancies between the current theoretical predictions and observed clinical results are also possible for haemofiltration and haemodialysis treatments if membranes with unique transport properties are employed.
We conclude that solute clearances during DHF with an exchange volume of
40% of total body water six times per week are theoretically equivalent to, or better than, those during HFHD and CAPD (based on stdKt/V). These calculations therefore suggest that DHF is practical in today's environment, given the approximate time required to perform the daily treatment and the similarity in fluid requirements to current therapy modalities (CAPD and automated forms of peritoneal dialysis). These theoretical predictions require clinical validation.
| Appendix |
|---|
|
|
|---|
The equations governing solute concentrations in the perfused and non-perfused compartments are based on mass balances within each compartment as described previously [7]:
|
|
|
|
|
|
|
|
|
|
|
|
Solute and volume removal rates were dependent on the treatment modality. During DHF, the solute removal rate was described by the following equation:
|
|
|
|
Solute removal rates during CAPD were calculated from the following equation [11]:
|
|
are reported in Table 2|
|
Conflict of interest statement. J.K.L. and B.L.J. are currently conducting research sponsored by NxStage medical. J.M. is a member of the Scientific Advisory Board for NxStage medical. M.J.L. and J.T.M. have declared no conflicts of interest.
| Acknowledgments |
|---|
This work was supported by the Department of Veterans Affairs, Dialysis Research Foundation (Ogden, UT) and Nxstage Medical (Lawrence, MA).
| Notes |
|---|
Correspondence and offprint requests to: John K. Leypoldt, PhD, Dialysis Program, University of Utah, 85 North Medical Drive, East Room 201, Salt Lake City, UT 84112-5350, USA. Email: ken.leypoldt{at}hsc.utah.edu
| References |
|---|
|
|
|---|
- Henderson LW, Besarab A, Michaels A, Bluemle LW Jr. Blood purification by ultrafiltration and fluid replacement (diafiltration). Trans Am Soc Artif Intern Organs 1967; 13:216222
- Quellhorst EA. Long-term survival. In: Henderson LW, Quellhorst EA, Baldamus CA, Lysaght MJ, eds. Hemofiltration. Springer, Berlin:1986;221232
- Locatelli F, Marcelli D, Conte F, Limido A, Malberti F, Spotti D for The Registro Lombardo Di E Trapianto. Comparison of mortality in ESRD patients on convective and diffusive extracorporeal treatments. Kidney Int 1999; 55:286293[CrossRef][Web of Science][Medline]
- Henderson LW, Leypoldt JK. Quantitation and prescription of therapy. In: Henderson LW, Quellhorst EA, Baldamus CA, Lysaght MJ, eds. Hemofiltration. Springer, Berlin: 1986; 129145
- Ledebo I. Predilution hemofiltration: a new technology appplied to an old therapy. Int J Artif Organs 1995; 18:735742[Medline]
- Ledebo I. Does convective dialysis therapy applied daily approach renal blood purification? Kidney Int 2001; 59 [Suppl 78]:286291
- Clark WR, Leypoldt JK, Henderson LW, Mueller BA, Scott MK, Vonesh EF. Quantifying the effect of changes in the hemodialysis prescription on effective solute removal with a mathematical model. J Am Soc Nephrol 1999; 10:601609
[Abstract/Free Full Text] - Casino FG, Lopez T. The equivalent renal urea clearance: a new parameter to assess dialysis dose. Nephrol Dial Transplant 1996; 11:15741581
[Abstract/Free Full Text] - Gotch FA. The current place of urea kinetic modelling with respect to different dialysis modalities. Nephrol Dial Transplant 1998; 13 [Suppl 6]:1014[Medline]
- Kloppenburg WD, Stegeman CA, de Jong PE, Huisman RM. Anthropometry-based equations overestimate the urea distribution volume in hemodialysis patients. Kidney Int 2001; 59:11651174[CrossRef][Web of Science][Medline]
- Pyle WK. Mass Transfer in Peritoneal Dialysis. Ph.D. Dissertation, University of Texas at Austin, TX,1981
- Fresenius Medical Care, Bad Homburg, Germany. Document number 7503301, 05/98, SWD,1998
- Gambro Renal Products, Lund, Sweden. Document number 201-150-164, Rev. D, 2000
- Pierratos A, Ouwendyk M, Francoeur R et al. Nocturnal hemodialysis: three-year experience. J Am Soc Nephrol 1998; 9:859868[Abstract]
- Odell RA, Slowiaczek P, Moran JE, Schindhelm K. Beta 2-microglobulin kinetics in end-stage renal failure. Kidney Int 1991; 39:909919[Medline]
- Forsythe GE, Malcolm MA, Moler CB. Computer Methods for Mathematical Computations. Prentice-Hall, Englewood Cliffs: 1977
- National Kidney Foundation. K/DOQI clinical practice guidelines for hemodialysis adequacy, 2000. Am J Kidney Dis 2001; 37 [Suppl 1]:S7S64
- National Kidney Foundation. K/DOQI clinical practice guidelines for peritoneal dialysis adequacy, 2000. Am J Kidney Dis 2001; 37 [Suppl 1]:S65S136
- Gotch FA. Daily hemodialysis is a complex therapy with unproven benefits. Blood Purif 2001; 19:211216[Medline]
- Lacson E Jr, Diaz-Buxo JA. Daily and nocturnal hemodialysis: how do they stack up? Am J Kidney Dis 2001; 38:225239[Web of Science][Medline]
- Canaud B, Assounga A, Kerr P, Aznar R, Mion C. Failure of a daily haemofiltration programme using a highly permeable membrane to return ß2-microglobulin concentrations to normal in haemodialysis patients. Nephrol Dial Transplant 1992; 7:924930
[Abstract/Free Full Text] - Jaffrin MY. Convective mass transfer in hemodialysis. Artif Organs 1995; 19:11621171[Medline]
- Babb AL, Johansen PJ, Strand MJ, Tenckhoff H, Scribner BH. Bi-directional permeability of the human peritoneum to middle molecules. Proc EDTA 1973; 10:247262
- Krediet RT. The physiology of peritoneal solute transport and ultrafiltration. In: Gokal R, Khanna R, Krediet RT, Nolph KD, eds. Textbook of Peritoneal Dialysis, 2nd Edn. Kluwer Academic, Dordrecht:2000;135172
Accepted in revised form: 14.11.02
![]()
CiteULike
Connotea
Del.icio.us What's this?
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||







