NDT Advance Access published online on June 5, 2007
Nephrology Dialysis Transplantation, doi:10.1093/ndt/gfm108
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Ionic dialysance and the assessment of Kt/V: the influence of different estimates of V on method agreement
1Department of Internal Medicine, Máxima Medical Centre, Veldhoven and 2Department of Internal Medicine, University Hospital, Maastricht, The Netherlands
Correspondence and offprint requests to: Jeroen P. Kooman, University Hospital Maastricht, PO Box 5800, 6202 AZ Maastricht, The Netherlands. Email: jkoo{at}sint.azm.nl
| Abstract |
|---|
|
|
|---|
Background. Ionic dialysance was recently introduced as a means to assess Kt/V (KIDt/V). With this method, urea distribution volume (V) has to be estimated. The primary aim of the present study was to assess the agreement between equilibrated Kt/V assessed by urea kinetic modelling (eKt/V) with KIDt/V taking into account different estimates of V, and to assess the monthly variation in V. Secondly, the mechanisms behind the intra-treatment changes in ionic dialysance and inter-treatment variability of KIDt/V were assessed.
Methods. Sixty-six patients were included. eKt/V was estimated using 30 min post-treatment sampling in the second generation Daugirdas equation. V was assessed by the formulae of Watson and Chertow (VWatson; VChertow), double-pool urea kinetic modelling (VUKM) and by ionic dialysance (VIOD) [Diascan; Hospal®].
Results. The use of VUKM or VIOD instead of VWatson or VChertow improved the relation between eKt/V and KIDt/V (both r = 0.93; P < 0.001 vs r = 0.84 and r = 0.81; P < 0.001). Mean values of eKt/V (1.19 ± 0.21), KIDt/VUKM (1.19 ± 0.30) and KIDt/VIOD (1.21 ± 0.25) were comparable.
Intra-class correlation coefficient of VIOD was 0.87 with a 1-month interval and <0.75 after 2 and 3 months. Intra-class correlation coefficient of VDP was 0.79 with a 1-month interval and <0.75 after 2 and 3 months.
Inter-treatment variation in KIDt/V during six consecutive dialysis sessions was 6.1% ± 0.6%. Changes in blood flow were the main determinant of variations in KIDt/V (P < 0.05). During treatment, ionic dialysance decreased by 12 ± 13 ml/min (P < 0.001). The decline in blood volume was the major determinant of the intra-dialytic change in ionic dialysance (P < 0.05).
Conclusion. The use of VIOD and VUKM results in better agreement between eKt/V and KIDt/V compared with anthropometric formulae. KIDt/V was comparable with eKt/V and thus lower than expected for a single-pool method. VIOD and VUKM, should be assessed at least monthly. KIDt/V varies widely between consecutive dialysis sessions, mainly due to differences in blood flow. During treatment, ionic dialysance decreases, which is related to the relative decline in blood volume.
Keywords: dialysis dose; ionic dialysance; Kt/V; variability; urea distribution volume
| Introduction |
|---|
|
|
|---|
An adequate delivery of haemodialysis treatment dose is an important factor in the morbidity and mortality of patients treated with haemodialysis [1]. Regular evaluation of delivered treatment dose, commonly performed by measurement of Kt/V, is necessary to intervene when the delivered treatment is inadequate.
To assess Kt/V, the second generation Daugirdas formula is advocated by both K-DOQI and EDTA guidelines [2,3]. Both guidelines recommend measurement of haemodialysis dose at least once a month. Recent studies suggest that substantial variation in delivery of Kt/V occurs within intra-individual haemodialysis treatments on a session-to-session basis [4,5]. Thus, a more frequent assessment of Kt/V is desirable. However, the need for blood sampling makes more frequent assessment of Kt/V by the standard approach, impractical.
Techniques based on measurement of ionic dialysance facilitate the evaluation of dialysis dose by online monitoring of the Kt/V (KIDt/V) [68]. Assessment of dialysis dose based on ionic dialysance was shown to correlate well with Kt/V assessed by traditional urea kinetic modelling [8,9]. However, despite highly significant correlations, several studies showed either lower or higher values of KIDt/V compared with Kt/V assessed by urea kinetic modelling. One reason for these differences is the fact that in some studies, KIDt/V, which is a single-pool model, was compared with equilibrated Kt/V (eKt/V) [5,8]. However, another factor which is likely to play a major role in the disagreement between KIDt/V and Kt/V assessed by traditional modelling is the estimation of urea distribution volume (V). With the ionic dialysance method, V has to be inserted in order to calculate the final KIDt/V. So far, in the studies which addressed KIDt/V, most commonly the Watson formula is used to assess V (VWatson) [8]. However, several studies questioned the reliability of these anthropometry-based equations [4,11].
Assessment of V by urea kinetic modelling (VUKM) may be more reliable in this aspect [18]. Recently, an estimate of V with the use of ionic dialysance measurements has been proposed (VIOD), which correlated very well with V obtained by direct dialysis quantification and bio-impedance measurements [12,13]. However, a comparison of VIOD with other estimates of V regarding the agreement between Kt/V, assessed by urea kinetic modelling and KIDt/V was only assessed in one study in 10 patients [13]. Moreover, the frequency by which VIOD or VUKM would have to be assessed is not known.
Two previous studies showed substantial inter-treatment variations in KIDt/V [5,14]. Although the mechanisms behind these variations remain partly understood, inter-treatment differences in dialysis time and blood flow rate appear to be major determinants [5]. However, until now, only one study has assessed determinants of inter-treatment variations in KIDt/V [5]. One recent study also made apparent that ionic dialysance might change during the dialysis therapy [15]. Although systemic salt loading due to the conductivity measurements might be partly responsible for this phenomenon, also a reduction in clearance per se, e.g. due to fouling of the membrane, might lead to a reduction in ionic dialysance.
The primary aim of the present study was, firstly, to assess the agreement between KIDt/V with eKt/V taking into account different estimates of V.
Secondly, possible mechanisms behind the inter-treatment variability of KIDt/V and intra-treatment changes in ionic dialysance were assessed.
| Patients and methods |
|---|
|
|
|---|
Patients
Of our HD patient population, we asked all patients who had been on dialysis for more than three months to participate in the present study. Three patients refused to participate. Sixty-six patients were included in the study.
No changes were made to the dialysis prescriptions over the study period. The study protocol was approved by the local medical ethical committee and informed consent was obtained from each patient. Patient characteristics are displayed in Table 1. In 13 patients, residual renal function was present. Mean GFR in these patients was 2.4 ± 2.6 ml/min. Three patients had a central venous catheter. The others were dialysed by either forearm or upper arm fistula or PTFE grafts. Three patients were dialysed two times weekly, the others three times weekly.
|
Study protocol
The agreement between eKt/V and KIDt/V was assessed after the longest dialysis interval. The inter-treatment variation in KIDt/V (using VWatson) was assessed during six consecutive treatments, as was the intra-treatment variation in ionic dialysance. All treatments were monitored for changes in blood flow, relative blood volume, ultrafiltration volume, treatment time, venous pressure, arterial pressure and transmembrane pressure.
Dialysis strategy
All but three patients (as mentioned earlier) were treated three times weekly with haemodialysis, using bicarbonate as buffer and a sodium dialysate concentration of 138 mmol/l. Polysulfone (F8HPS;Fresenius®) dialysis membranes were used. Target blood flow was 300 ml/min, whereas reached blood flow was 275 ± 40 ml/min.
Urea kinetic modelling
Pre- and post-dialysis serum urea samples were taken to measure urea reduction at the dialysis session after the longest interval. Post-dialysis blood samples for assessment of eKt/V were drawn by venipuncture 30 min after the end of dialysis. The eKt/V was estimated using the second generation Daugirdas equation with the 30 min post-dialytic blood samples added in [2,3]. Also single-pool Kt/V was assessed employing the second generation Daugirdas equation (appendix), using post-dialytic samples drawn 2 min after dialysis.
Ionic dialysance
KIDt/V was measured online by Diascan® (Hospal-Gambro®) [6,16]. The calculation of the mean ionic dialysance is based on differences in inlet and outlet conductivity values after a conductivity pulse of 1mS/cm every 30 min. Mean ionic dialysance multiplied by the real duration of the session is used to calculate KIDt. KIDt was divided by VWatson, (VChertow), VUKM and VIOD, respectively, to assess agreement with eKt/V.
Determinants of inter-treatment changes in KIDt/Vwatson were assessed during six consecutive treatments (n = 396).
During the same treatments, determinants of intra-treatment variations in ionic dialysance were assessed.
Urea distribution volume
V was determined using anthropometrically derived V (VWatson), based on the Watson formula, taking into account post-dialysis weight, height, gender and age [17]. V was also determined using the Chertow formula [18] (appendix).
In addition, V was assessed based on the formula recently proposed by di Filippo et al. taking into account both plasma urea samples and ionic dialysance measurements (VIOD) (appendix) [12]. Post-dialysis blood samples for assessment of VIOD and VUKM were drawn 2 min after the end of dialysis using the slow flow technique [11]. VUKM was calculated using the calculator available on the HDCN page (http://www.hdcn.com/calcf/dzer.htm). This calculator is based on the two-urea sampling approach as described in [19]. The single-pool volume is corrected by the programme to a double-pool volume as described in [20] (appendix). Variations in VIOD and VUKM were reported during the first dialysis session of the first week of four consecutive months.
Changes in relative blood volume
Changes in relative blood volume are determined by an on-line optical method (Hemoscan®; Hospal-Gambro®), assessing relative blood volume changes from blood haemoglobin concentration changes.
Statistical analysis
The agreement between data was analysed using pearson's r and BlandAltman analysis [21]. Differences between eKt/V and KIDt/V using the different estimates of V were assessed by the student t-test. The standard deviation in KIDt/V and ionic dialysance during the six different treatments were related to the standard deviation of various potential determinants. Multivariate analysis was used to assess determinants of inter-dialytic variation in KIDt/V and intra-treatment changes in ionic dialysance. P values <0.05 were considered significant. The variations in VIOD and VUKM were also assessed using the coefficient of variation and the intra-class correlation coefficient. An intra-class correlation coefficient <0.85 was considered unacceptable for clinical purposes. The SPSS-12.0 package was used for statistical analysis.
| Results |
|---|
|
|
|---|
Agreement between KIDt/V and eKt/V in relation to different estimates of V
In five patients with inter-dialytic weight gain <0,1 kg, the formula for VIOD yielded unreliable results (NB: in patients with inter-dialytic weight gain >0.3 kg, adequate values for VIOD could be calculated. No patient had inter-dialytic weight gains between 0.1 and 0.3 kg). Therefore, data of 61 patients were analysed.
The eKt/V was 1.19 ± 0.21. KIDt/V was 1.12 ± 0.21 when corrected for VWatson (P < 0.001 compared with eKt/V) 1.00 ± 0.19 when corrected for VChertow (P < 0.001); 1.19 ± 0.30 when corrected for VUKM (P = ns) and 1.21±0.25 (P = ns) when corrected for VIOD. Single-pool Kt/V, assessed by urea kinetic modeling, was 1.32 ± 0.31 (P < 0.001).
The correlation between KIDt/V and eKt/V was highly significant (r = 0.84 and r = 0.81; P < 0.001), both when using VWatson and VChertow as an estimate of V, although a significant difference between both methods was observed [0.08 ± 0.13; P < 0.05] and [0.20 ± 0.13] with wide limits of agreement (Figure 1). Both when using VUKM and VIOD as estimates of V, the correlation between KIDt/V and eKt/V became stronger (both r = 0.93 P < 0.001) and limits of agreement were narrower [0.00 ±0.09] and [0.01 ± 0.14] (Figures 2 and 3).
|
|
|
Monthly variation of VIOD and VDP
Coefficient of variation of VIOD was 15.7% when VIOD measurements were compared with a one-month interval, 19.7% when VIOD was compared with a two-month, and 15.7% when VIOD was compared with a three-month interval.
Intra-class correlation coefficient of VIOD was 0.87 when VIOD measurements were compared with a one-month interval, 0.68 when VIOD was compared with a two-month, and 0.74 when VIOD was compared with a three-monthly interval.
Coefficient of variation of VUKM was 9.5% when VUKM measurements were compared with a one-month interval, 16% when VUKM was compared with a two-monthly, and 11.7% when VUKM was compared with a three-monthly interval.
Intra-class correlation coefficient of VUKM varied from 0.79, 0.73 and 0.57, respectively with a one-, two- and three-monthly interval.
Inter-treatment variation in KIDt/V and intra-treatment variation in ionic dialysance
Three hundred and ninety-six sessions were studied. Mean coefficient of variation of KIDt/V between the six measurements was 6.1% ± 4.1% (range 1.321.5%). The inter-treatment variation in KIDt/V is displayed in Figure 4.
|
With multivariate analysis, the variation in blood flow appeared to be the independent parameter explaining the variation in KIDt/V (Table 2).
|
Mean ionic dialysance at the start of dialysance was 170 ± 17 ml/min.
During treatment, ionic dialysance declined by a mean of 11.8 ± 8.9 ml/min (P < 0.001). With multivariate analysis, the intra-treatment change in ionic dialysance was significantly related to the decline in relative blood volume and blood flow rate (Table 3).
|
| Discussion |
|---|
|
|
|---|
Our study confirms previous findings [5,6,811,22,23] of a good correlation between KIDt/V and Kt/V assessed by urea kinetic modelling, but showed significant differences between both methods when anthropometric formulae were used to estimate V. Compared with our study, McIntyre et al. showed a better agreement between KIDt/V and eKt/V with VWatson as an estimate of V, but studied a more homogeneous group of patients. We studied an unselected group of dialysis patients, nearly comprising the entire haemodialysis population of a single centre. Recent studies questioned the reliability of the anthropometry-based equations and suggested that assessment of V assessed by urea kinetic modelling might be more reliable in this aspect [4,12].
When using VUKM or VIOD in the present study, the relation between eKt/V and KIDt/V improved. Mean values of eKt/V and KIDt/V were nearly comparable, despite the fact that KIDt/V is calculated according to a single-pool model. This is in agreement with the results of McIntyre et al. who also showed comparable values between eKt/V and KIDt/V, but in contrast to the data of Filippo et al. who showed higher values for KIDt/V compared with eKt/V, and to the study of Wuepper et al. where KIDt/V was comparable with single-pool Kt/V [5,12,13]. It has been postulated that ionic dialysance may underestimate effective urea clearance due to the effects of systemic salt loading during the ionic dialysance measurements, resulting in a reduced conductivity diffusion gradient across the dialyser, especially when urea clearance is >150 ml/min [15]. This might explain the fact that KIDt/V, both in our study and in the study of McIntyre, was lower than expected for a single-pool model [5].
Differences between the results obtained by Filippo et al. on one hand, and McIntyre and our study on the other hand, could theoretically be explained by lower levels of urea clearance in the former study [5,12]. However, this is unlikely in view of the fact that ionic dialysance in patients studied by Filippo was comparable with our patients [12]. In contrast to most other studies, Wuepper et al. used a model based on a two-step change in conductivity, which has different effects on systemic changes in sodium [13,15].
However, even with a two-step change in conductivity, ionic dialysance may underestimate urea removal [23], which may be related to the effects of cardiopulmonary recirculation [24].
VIOD, calculated according to single-pool kinetics, yielded comparable data to VUKM, calculated according to double-pool kinetics. This is in agreement with the data of Filippo who showed comparable results between V assessed by direct dialysis quantification (a double pool V) and VIOD [12]. It has been shown that with haemodialysis with conventional dose prescriptions the ratio between V assessed by single-pool and double-pool kinetics is nearly one to one [25]. A drawback of our study is the fact that we did not calculate V according to direct dialysis quantification or bio-impedance analysis.
In the small proportion of patients with inter-dialytic weight gain <0.1 kg, calculation of VIOD yielded unreliable values, which may possibly be due to the fact that VIOD was calculated according to single pool variable volume kinetics.
If V is to be assessed by VIOD or VUKM, the question arises how often V should be measured. Kloppenburg et al. showed relatively large intra-patient variability in V assessed by urea kinetic modelling [4]. From the data in the present study, the variability in VIOD or VUKM during a one-month period would appear acceptable for clinical purposes, but not when measurements of V are performed with longer time intervals.
In agreement with earlier data of Lambie et al. [14], a significant inter-treatment variation in KIDt/V was observed. In our study, this variation appeared to be mainly related to variations in blood flow rate. Although blood flow rate is routinely prescribed as 300 ml/min in our centre, sometimes the blood flow rate had to be decreased in response to changes in venous or arterial pressure, among other reasons, due to needle malpositions. The variations in blood flow rate between treatments are in agreement with the study of Lambie et al. [14]. In our study, changes in treatment time played less of a role compared with the findings of Stewart et al. because treatment time was basically kept unchanged.
In the present study, a decline in ionic dialysance during the dialysis session was observed, which also was described by Gotch et al. [15]. The change in ionic dialysance was related to the change in relative blood volume. The mechanism behind this phenomenon remains to be determined. However, it may be hypothesized that increased clotting of proteins to the dialyser membrane might be involved in less diffusive capacities. In addition, also systemic salt loading due to the conductivity measurements per se might affect measurements of ionic dialysance during dialysis [15]. This phenomenon is especially relevant above a urea clearance of 150 ml/min [15] and therefore may also have played a role in the measured changes in the present study. Also, due to the haemoconcentration, the blood water flow rate decreases, resulting in a decline in urea clearance and ionic dialysance during the session.
Concluding, KIDt/V is a useful tool to assess dialysis dose. The use of VIOD and VUKM result in better agreement between eKt/V and KIDt/V compared with anthropometric formulae. KIDt/V was comparable with eKt/V, and thus, lower than expected for a single-pool method. Due to the variability in VIOD and VUKM these parameters should be assessed at least monthly. KIDt/V varies widely between consecutive dialysis sessions, mainly due to differences in blood flow. During treatment, ionic dialysance decreases, which is related to the relative decline in blood volume.
Conflict of interest statement. None declared.
| Appendix |
|---|
|
|
|---|
Mathematical definitions
eKt/V:
|
|
|
|
|
|
|
|
|
|
and
|
|
VIOD:
|
|
G (mg/min):
|
|
VChertow:
|
|
where
male is equal to 1 for males and 0 for females and
diabetes is 1 for diabetics and 0 for non-diabetics.
| References |
|---|
|
|
|---|
- Held P, Levin N, Bovbjerg RR, Pauly MV, Diamond LH. Mortality and duration of hemodialysis treatment. J Am Med Assoc (1991) 265:871875. i: 307310.
[Abstract/Free Full Text] - NKF-K/DOQI Clinical Practice Guidelines for Hemodialysis Adequacy: update 2000. Am J Kidney Dis (2001) 37(1 Suppl 1):S7S64.[Web of Science][Medline]
- European Best Practice Guidelines Expert Group on Hemodialysis, European Renal Association. Section II. Haemodialysis adequacy. Nephrol Dial Transplant (2002) 17(Suppl 7):1631.
[Abstract/Free Full Text] - Kloppenburg W, Stegeman C, Hooyschuur M, van der Ven J, de Jong PE, Huisman RM. Assessing dialysis adequacy and dietary intake in the individual hemodialysis patient. Kidney Int (1999) 55:19611969.[CrossRef][Web of Science][Medline]
- McIntyre CW, Lambie SH, Taal MW, Fluck RJ. Assessment of haemodialysis adequacy by ionic dialysance: intra-patient variability of delivered treatment. Nephrol Dial Transplant (2003) 18:55963.
[Abstract/Free Full Text] - Petitclerc T, Béné B, Jacobs C, Jaudon MC, Goux N. Non-invasive monitoring of effective dialysis dose delivered to the dialysis patient. Nephrol Dial Transplant (1995) 10:212216.
[Abstract/Free Full Text] - Lindsay R, Bene B, Goux N, Heidenheim A, Landgren C, Sternby J. Relationship between effective ionic dialysance and in vivo urea clearance during haemodialysis. Am J Kidney Dis (2001) 38:565574.[Web of Science][Medline]
- Mercadal L, Ridel C, Petitclerc T. Ionic dialysance: principle and review of its clinical relevance for quantification of hemodialysis efficiency. Hemodial Int (2005) 9:1119.[CrossRef][Medline]
- Di Filippo S, Andrulli S, Manzoni C, Corti M, Locatelli F. On-line assessment of delivered dialysis dose. Kidney Int (1998) 54:263267.[CrossRef][Web of Science][Medline]
- Manzoni C, Di Filippo S, Corti M, Locatelli F. Ionic dialysance as a method for the on-line monitoring of delivered dialysis without blood sampling. Nephrol Dial Transplant (1996) 11:20232030.
[Abstract/Free Full Text] - Mercadal L, Petitclerc T, Jaudon MC, Béné B, Goux N, Jacobs C. Is Ionic dialysance a valid parameter for quantification of dialysis efficiency? Artif Organs (1998) 22:10051009.[CrossRef][Web of Science][Medline]
- Di Filippo S, Manzoni C, Andrulli S, et al. Ionic dialysance allows an adequate estimate of urea distribution volume in hemodialysis patients. Kidney Int (2004) 66:78691.[CrossRef][Web of Science][Medline]
- Wuepper A, Tattersall J, Kraemer M, Wilkie M, Edwards L. Determination of urea distribution volume for Kt/V assessed by conductivity monitoring. 1:. Kidney Int (2003) 64:226271.[CrossRef][Web of Science][Medline]
- Lambie SH, Taal MW, Fluck RJ, McIntyre CW. Analysis of factors associated with variability in haemodialysis adequacy. Nephrol Dial Transplant (2004) 19:40612.
[Abstract/Free Full Text] - Gotch FA, Panlilio FM, Buyaki RA, Wang EX, Folden TI, Levin NW. Mechanisms determining the ratio of conductivity clearance to urea clearance. Kidney Int Suppl (2004 Jul) (89):S324.[Medline]
- Bosetto A, Bene B, Petitclerc T. Sodium management in dialysis by conductivity. Adv Ren Replace Ther (1999) 6:24354.[Web of Science][Medline]
- Watson P, Watson I, Batt R. Total body water volumes for adult male and females estimated from simple anthropometric measurements. Am J Clin Nutr (1980) 33:2739.
[Abstract/Free Full Text] - Daugirdas JT, Greene T, Depner TA, Chumlea C, Rocco MJ, Chertow GM;, Hemodialysis (HEMO) Study Group. Anthropometrically estimated total body water volumes are larger than modeled urea volume in chronic hemodialysis patients: effects of age, race, and gender. Kidney Int (2003) 64:110819.[CrossRef][Web of Science][Medline]
- Depner TA. Prescribing Hemodialysis: A Guide to Urea Modeling. In: Appendix B. (1991) Boston: Kluwer Academic Publishers.
- Daugirdas JT, Smye SW. Effect of a two compartment distribution on apparent urea distribution volume. Kidney Int (1997) 51:12701273.[Web of Science][Medline]
- Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet (1986) 307310.
- Kuhlmann U, Goldau R, Samadi N, Graf T, Gross M. Accuracy and safety of online clearance monitoring based on conductivity variation. Nephrol Dialysis Transplant (2001) 16:10531058.
[Abstract/Free Full Text] - Racki S, Zaputovic L, Maleta, et al. Assessment of hemodialysis adequacy by ionic dialysance: comparison to standard method of urea removal. Ren Fail (2005) 27:6014.[CrossRef][Web of Science][Medline]
- Mercadal L, Montcel S, Jaudon M, et al. Ionic dialysance vs. urea clearance in the absence of cardiopulmonary recirculation. Nephrol Dialysis Transplant (2002) 17:106111.
[Abstract/Free Full Text] - Daugirdas JT, Greene T, Depner TA, Gotch FA, Star RA, and the Hemodialysis (HEMO) study group. Relation between apparent (single-pool) and true (double-pool) urea distribution volume. Kidney Int (1999) 56:19281933.[CrossRef][Web of Science][Medline]
Accepted in revised form: 8. 2.07
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
K. Moret, D. C. Grootendorst, C. Beerenhout, and J. P. Kooman Conductivity pulses needed for Diascan(R) measurements: does it cause sodium burden? NDT Plus, August 1, 2009; 2(4): 334 - 335. [Full Text] [PDF] |
||||
![]() |
E. J. Lindley, P. W. Chamney, A. Wuepper, H. Ingles, J. E. Tattersall, and E. J. Will A comparison of methods for determining urea distribution volume for routine use in on-line monitoring of haemodialysis adequacy Nephrol. Dial. Transplant., January 1, 2009; 24(1): 211 - 216. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||








