Continuation Results On 48 Weeks of Use Of Open Source Automated Insulin Delivery From the CREATE Trial: Safety And Efficacy Data

In addition to the primary endpoint results from the CREATE trial, which you can read more about in detail here or as published in the New England Journal of Medicine, there was also a continuation phase study of the CREATE trial. This meant that all participants from the CREATE trial, including those who were randomized to the automated insulin delivery (AID) arm and those who were randomized to sensor-augmented insulin pump therapy (SAPT, which means just a pump and CGM, no algorithm), had the option to continue for another 24 weeks using the open source AID system.

These results were presented by Dr. Mercedes J. Burnside at #EASD2022, and I’ve summarized her presentation and the results below on behalf of the CREATE study team.

What is the “continuation phase”?

The CREATE trial was a multi-site, open-labeled, randomized, parallel-group, 24-week superiority trial evaluating the efficacy and safety of an open-source AID system using the OpenAPS algorithm in a modified version of AndroidAPS. Our study found that across children and adults, the percentage of time that the glucose level was in the target range of 3.9-10mmol/L [70-180mg/dL] was 14 percentage points higher among those who used the open-source AID system (95% confidence interval [CI], 9.2 to 18.8; P<0.001) compared to those who used sensor augmented pump therapy; a difference that corresponds to 3 hours 21 minutes more time spent in target range per day. The system did not contribute to any additional hypoglycemia. Glycemic improvements were evident within the first week and were maintained over the 24-week trial. This illustrates that all people with T1D, irrespective of their level of engagement with diabetes self-care and/or previous glycemic outcomes, stand to benefit from AID. This initial study concluded that open-source AID using the OpenAPS algorithm within a modified version of AndroidAPS, a widely used open-source AID solution, is efficacious and safe. These results were from the first 24-week phase when the two groups were randomized into SAPT and AID, accordingly.

The second 24-week phase is known as the “continuation phase” of the study.

There were 52 participants who were randomized into the SAPT group that chose to continue in the study and used AID for the 24 week continuation phase. We refer to those as the “SAPT-AID” group. There were 42 participants initially randomized into AID who continued to use AID for another 24 weeks (the AID-AID group).

One slight change to the continuation phase was that those in the SAPT-AID used a different insulin pump than the one used in the primary phase of the study (and 18/42 AID-AID participants also switched to this different pump during the continuation phase), but it was a similar Bluetooth-enabled pump that was interoperable with the AID system (app/algorithm) and CGM used in the primary outcome phase.

All 42 participants in AID-AID completed the continuation phase; 6 participants (out of 52) in the SAPT-AID group withdrew. One withdrew from infusion site issues; three with pump issues; and two who preferred SAPT.

What are the results from the continuation phase?

In the continuation phase, those in the SAPT-AID group saw a change in time in range (TIR) from 55±16% to 69±11% during the continuation phase when they used AID. In the SAPT-AID group, the percentage of participants who were able to achieve the target goals of TIR > 70% and time below range (TBR) <4% increased from 11% of participants during SAPT use to 49% during the 24 week AID use in the continuation phase. Like in the primary phase for AID-AID participants; the SAPT-AID participants saw the greatest treatment effect overnight with a TIR difference of 20.37% (95% CI, 17.68 to 23.07; p <0.001), and 9.21% during the day (95% CI, 7.44 to 10.98; p <0.001) during the continuation phase with open source AID.

Those in the AID-AID group, meaning those who continued for a second 24 week period using AID, saw similar TIR outcomes. Prior to AID use at the start of the study, TIR for that group was 61±14% and increased to 71±12% at the end of the primary outcome phase; after the next 6 months of the continuation phase, TIR was maintained at 70±12%. In this AID-AID group, the percentage of participants achieving target goals of TIR >70% and TBR <4% was 52% of participants in the first 6 months of AID use and 45% during the continuation phase. Similarly to the primary outcomes phase, in the continuation phase there was also no treatment effect by age interaction (p=0.39).

The TIR outcomes between both groups (SAPT-AID and AID-AID) were very similar after each group had used AID for 24 weeks (SAPT-AID group using AID for 24 weeks during the continuation phase and AID-AID using AID for 24 weeks during the initial RCT phase).. The adjusted difference in TIR between these groups was 1% (95% CI, -4 to 6; p=-0.67). There were no glycemic outcome differences between those using the two different study pumps (n=69, which was the SAPT-AID user group and 18 AID-AID participants who switched for continuation; and n=25, from the AID-AID group who elected to continue on the pump they used in the primary outcomes phase).

In the initial primary results (first 24 weeks of trial comparing the AID group to the SAPT group), there was a 14 percentage point difference between the groups. In the continuation phase, all used AID and the adjusted mean difference in TIR between AID and the initial SAPT results was a similar 12.10 percentage points (95% CI, p<0.001, SD 8.40).

Similar to the primary phase, there was no DKA or severe hypoglycemia. Long-term use (over 48 weeks, representing 69 person-years) did not detect any rare severe adverse events.

CREATE results from the full 48 weeks on open source AID with both SAPT (control) and AID (intervention) groups plotted on the graph.

Conclusion of the continuation study from the CREATE trial

In conclusion, the continuation study from the CREATE trial found that open-source AID using the OpenAPS algorithm within a modified version of AndroidAPS is efficacious and safe with various hardware (pumps), and demonstrates sustained glycaemic improvements without additional safety concerns.

Key points to takeaway:

  • Over 48 weeks total of the study (6 months or 24 weeks in the primary phase; 6 months/24 weeks in the continuation phase), there were 64 person-years of use of open source AID in the study, compared to 59 person-years of use of sensor-augmented pump therapy.
  • A variety of pump hardware options were used in the primary phase of the study among the SAPT group, due to hardware (pump) availability limitations. Different pumps were also used in the SAPT-AID group during the AID continuation phase, compared to the pumps available in the AID-AID group throughout both phases of trial. (Also, 18/42 of AID-AID participants chose to switch to the other pump type during the continuation phase).
  • The similar TIR results (14 percentage points difference in primary and 12 percentage points difference in continuation phase between AID and SAPT groups) shows durability of the open source AID and algorithm used, regardless of pump hardware.
  • The SAPT-AID group achieved similar TIR results at the end of their first 6 months of use of AID when compared to the AID-AID group at both their initial 6 months use and their total 12 months/48 weeks of use at the end of the continuation phase.
  • The safety data showed no DKA or severe hypoglycemia in either the primary phase or the continuation phases.
  • Glycemic improvements from this version of open source AID (the OpenAPS algorithm in a modified version of AndroidAPS) are not only immediate but also sustained, and do not increase safety concerns.
CREATE Trial Continuation Results were presented at #EASD2022 on 48 weeks of use of open source AID

NEJM Publishes RCT On Open Source Automated Insulin Delivery (OpenAPS Algorithm in AndroidAPS in the CREATE TRIAL)

First page of NEJM article on Open Source AID in T1D, which contains the text of the abstract. I’m thrilled to share that the results of the first RCT on open source automated insulin delivery (AID) is now published in a peer-reviewed medical journal (New England Journal of Medicine, known as NEJM). You can find it at NEJM here, or view an author copy here. You can also see a Twitter post here, if you are interested in sharing the study with your networks.

(I previously wrote a plain language summary of the study results after they were presented at ADA Scientific Sessions in June. You can read the plain language summary here, if you haven’t already seen it.)

I wanted to highlight a key few takeaway messages from the study:

  • The CREATE study found that across children and adults, the percentage of time that the glucose level was in the target range of 3.9-10mmol/L [70-180mg/dL] was 14.0 percentage points higher among those who used the open-source AID system compared to those who used sensor augmented pump therapy. This difference reflects 3 hours 21 minutes more time spent in target range per day!
  • For children AID users, they spent 3 hours 1 minute more time in target range daily (95% CI, 1h 22m to 4h 41m).
  • For adult AID users, they spent 3 hours 41 minutes more time in target range daily (95% CI, 2h 4m to 5h 18m).
  • Glycemic improvements were evident within the first week and were maintained over the 24-week trial. Meaning: things got better quickly and stayed so through the entire 24-week time period of the trial!
  • The CREATE study also found that the greatest improvements in time in range (TIR) were seen in participants with lowest TIR at baseline. This means one major finding of the CREATE study is that all people with T1D, irrespective of their level of engagement with diabetes self-care and/or previous glycemic outcomes, stand to benefit from AID. There is also no age effect observed in the trail, meaning that the results of the CREATE Trial demonstrated that open-source AID is safe and effective in children and adults with type 1 diabetes.

I’d also like to highlight some meta aspects of this trial and the significance of these results being published in NEJM.

The algorithm (open source, from OpenAPS) used in the trial, as well as the open source app (AndroidAPS) used to automate insulin delivery, were built by people with diabetes and their loved ones. The algorithm/initial AID work was made open source so other people with diabetes could use it if they chose to, but also so that researchers and clinicians could research it, learn from it, use it, etc. Speaking on behalf of Scott (Leibrand) who worked with me endlessly to iterate upon the algorithm and then also Ben West whose work was critical in communicating with insulin pumps and putting the pieces together into the first open source “closed loop” automated insulin delivery system: we all wanted this to be open source for many reasons. You’ll see some of those reasons listed at the bottom of the plain language OpenAPS “reference design” we shared with the world in February 2015. And it is exceptionally thrilling to see it go from n=1 (me, as the first user) to thousands worldwide using it and other open source AID systems over the years, and be studied further in the “gold standard” setting of an RCT to validate the real-world outcomes that people with diabetes have experienced with open source AID.

But these results are not new to those of us using these systems. These results every day are WHY we use and continue to choose each day to use these systems. This study highlights just a fraction of the benefits people with diabetes experience with AID. Over the years, I’ve heard any of the following reasons why people have chosen to use open source AID:

  • It’s peaceful and safer sleep with less fear of dying.
  • It’s the ability to imagine a future where they live to see their children grow up.
  • It’s the ability to manage glucose levels more effectively so they can more easily plan for or manage the process of having children.
  • It’s less time spent doing physical diabetes tasks throughout the days, weeks, and years.
  • It’s less time spent thinking about diabetes, diabetes-related short-term tasks, and the long-term aspects of living with diabetes.

All of this would not be possible without hundreds of volunteer contributors and developers who iterated upon the algorithm; adapted the concept into different formats (e.g. Milos Kozak’s work to develop AndroidAPS using the OpenAPS algorithm); wrote documentation; troubleshot and tested with different pumps, CGMs, hardware, phones, software, timezones, etc; helped others interested in using these systems; etc. There are many unsung heroes among this community of people with diabetes (and you can hear more of their stories and other milestones in the open source diabetes community in a previous presentation I gave here).

There are thousands of hours of work behind this open source technology which led to the trial which led to these results and this publication. Both the results and the fact of its publication in the NEJM are meaningful. This is technology developed by people with diabetes (and their loved ones) for people with diabetes, which more people will now learn is an option; it will fuel additional conversations with healthcare providers who support people with diabetes; and it will likely spur additional research and energy in the ongoing development of diabetes technologies.

From developers, to community contributors and community members, to the study team and staff who made this trial happen, to the participants in the trial, and to the peer reviewers and editor(s) who reviewed and recommended accepting the now-published article in the New England Journal of Medicine:

Thank you.

Graves’ Disease, Subclinical Hyperthyroidism, and Everything I Have Learned About It (So Far)

TLDR: I have newly diagnosed Graves’ Disease, I have associated eye stuff (called “Graves’ orbitopathy” or “Graves’ ophthalmopathy” or “thyroid eye disease”), subclinical hyperthyroidism, and a new learning curve. Below is what I’ve learned so far and what I’m still exploring.

As a person with type 1 diabetes (T1D) – which is an autoimmune disease – I am screened yearly for various high-risk related conditions. For example, celiac disease and thyroid issues, because those are fairly common in people with type 1 diabetes. I already have celiac disease (developed ~6 years after I developed T1D), but we have continued to screen every year in my annual blood work for thyroid markers, usually by screening T4 and TSH. Occasionally, T3 and/or TPO antibodies are also screened.

I remember vividly the chortle that my prior endocrinologist made after we diagnosed my celiac disease in college, probably in response to my comment about being frustrated of having “another” thing to deal with in addition to T1D. He chortled and said something like “once you have one (autoimmune thing), you’re likely to have two. Once you have two, you’ll be likely to have three.”

I didn’t like it at the time, and I don’t like it now. However, he’s not wrong. When your immune system has a little extra kick in it and you develop one autoimmune disease, the rates of having another autoimmune thing are increased. Thus, the typical yearly screening in T1D for celiac & thyroid.

I went 6 years between T1D and celiac, then almost 12-13 years to discover I now have exocrine pancreatic insufficiency (EPI). That’s not necessarily an autoimmune thing but may be a side effect of long-term T1D. Regardless, I was still thankful for the long period of time between T1D and celiac, then T1D+celiac and EPI. I was assuming that something else was coming eventually, but that I’d likely have a few years before the shoe dropped.

Nope.

I wasn’t terribly surprised when I scheduled my annual endocrinology appointment and did my annual blood work to find that one of my thyroid values was off. Specifically, my TSH (thyroid stimulating hormone) was low / below normal range. However, my T4 was smack dab in the middle of normal range. I got my blood work back Tuesday and waited for my virtual appointment on Friday to discuss in detail with my endocrinologist.

Since I’m me, I was curious about the interplay between normal thyroid levels (T4, and I suspected my T3 was likely still in range) but a low TSH value. What did that mean? General consensus seems to define this as “subclinical hyperthyroidism”. It’s not always treated, unless you are older (>65), have osteoporosis or heart disease, or TSH levels are <0.1.

I’m <65, don’t (as far as I know) have osteoporosis or heart disease, and my TSH levels are between 0.1 and 0.4, which is the low end of the normal range. So general treatment guidelines (see this example from the AAFP) suggest treatment isn’t necessarily warranted.

However…there’s more information that factors into the decision making. First, I had my last annual eye exam in October. All was well. Yet in November, I developed really gritty, dry eyes and went in for an appointment. I was diagnosed with dry eyes (gee, thanks!) and recommended to use gel drops at night before bed and regular eye drops during the day as needed. I did end up needing eye drops several times every day.

Then at the end of December or early January, we realized I had exocrine pancreatic insufficiency (EPI). I had been wondering if my dry eyes was related to the lack of digestion and absorption of nutrients, which also influences how my body uses the water content from food. It did seem to get a little better in the following months, because while I still needed the eye gel at night, I eventually moved to several days a week where I didn’t seem to need the eye drops during the day – yay!

However, in February and early March, I started to physically notice a shift in my resting overnight heart rate (HR). My Pebble 2+ HR watch and my Oura ring, both of which measure HR and heart rate variability (HRV), confirmed that both metrics were getting worse. I had a slowly increasing overnight HR and associated decrease in HRV. I am used to fluctuations, because the intensity of my ultrarunning can also influence HR the next day as a signal for whether my body has recovered yet or not. But instead of a day or two of increased numbers, I had an increasing trend line over several weeks, and it started to physically become bothersome. I actually raised the idea of getting my thyroid blood work done early this year, and was about to request the lab work, when after ~6 weeks or so the trend seemed to reverse and things (HR-wise) went back to “normal” for me.

Then I broke my toe in July and the same thing happened, but I chalked it up to sleep disruption from the pain and recovering from the fracture. My HR was continuing to rise even as the pain subsided and my toe was clearly healing. And looking back at my HR data, I can see it actually started to rise at the beginning of July, about two weeks before I broke my toe, so it’s not solely influenced by my broken toe.

As a result of these HR increases (that are noticeable and bothersome because I’m also not sleeping well at night and I physically feel the higher HR during the day), and the ongoing dry/gritty eyes, I suspected that the cause of my “subclinical hyperthyroidism” was Graves’ disease.

I’ve seen estimates that ~30% of people with Graves’ disease have what is called “Graves’ orbitopathy” (and other estimates suggest 20-50%, like this one), so the combination of my ongoing eye symptoms and the low TSH suggested that further lab work assessing various thyroid antibody levels would be able to confirm whether Graves’ disease was the likely source of the subclinical hyperthyroidism.

Therefore, I wasn’t surprised during my virtual visit that my endocrinologist ordered additional labs (repeat of T4 and TSH; adding in T3, TPO antibodies, and TSI (Thyroid Stimulating Immunoglobulin), Thyrotropin Receptor Ab, and Thyroglobulin Ab). Treatment plan, if any, would be based on these results.

I managed to get in that (Friday) afternoon for the repeat lab work, and my results started trickling in by the time I woke up Saturday morning. First, T3, T4, TPO, and TSH came back. T4 was still normal; as I expected, T3 was also normal. TPO antibodies were high, as expected, TSH was still low, as I expected. Saturday night, Thyroglobulin Ab came back high, as expected. Monday, TSI came back high, as expected. Tuesday, my last test result of Thyrotropin Receptor Ab came back, also high as expected.

The summary was: all antibodies high; TSH low; T3/T4 normal.

My endocrinologist messages me Tuesday afternoon confirming mild Graves’ disease with subclinical hyperthyroidism.

The challenge is that I have normal T3/T4 levels. If those were high, we’d treat based on those levels and use those levels coming back into normal range and any change in antibody levels to assess that things were going well.

But the guidelines for subclinical hyperthyroidism don’t really indicate treatment (except on an individual level based on age, other conditions, or undetectable TSH <0.1, as I mentioned).

However, from what I’ve read, the “eye stuff” seems to be driven not by thyroid levels but by the presence of the increased thyroid antibodies. Treatment would possibly bring down the thyroid antibody levels, which might help with the eye disease progression. But not a guarantee. So my doctor left it up to me to decide whether to treat it or not.

Given the ongoing presence of active eye disease (I haven’t been able to wear my contacts for two weeks right now due to swelling/pain in the eyes, plus itching and redness), and the bothersome heart rate feeling, I have decided to try antithyroid medication. I’ll be on a relatively low dose of an “antithyroid” drug, again with the goal of trying to reduce my antibody levels.

This is why I ended up deciding to write this blog post after all: I have not been able to find any clear treatment guidelines for subclinical hyperthyroidism and Graves’ disease with active eye symptoms (from Graves’ orbitopathy). The literature does suggest that treatment to reduce thyroid antibodies even with in-range T3 and T4, targeting a return to normal TSH levels, may be helpful in reducing Graves’ orbitopathy symptoms. This isn’t well known/established enough to have been documented in treatment guidelines, but does seem to occur in many people who are treated.

So hopefully, anyone else with low TSH and high antibodies suggesting Graves’ disease but normal T3 and T4 levels that suggests subclinical hyperthyroidism and also has other symptoms (whether that’s heart rate or other common hyperthyroid symptoms like increased sweating, shaking, heart palpitations, heat intolerance, sleep disturbances) that are bothersome, now have an example of what I chose, given my situation as described above.

I also thought sharing my question list at different stages for my endocrinologist would be helpful. After I saw that I had low TSH and in range T4, and suspected this meant I had subclinical hyperthyroidism from Graves’ disease, given my eye symptoms, the questions I asked my endocrinologist were:

  • What additional lab work did we need to confirm subclinical hyperthyroidism and Graves’ disease as the cause? What additional information or lab work would give us a treatment plan?As expected, he repeated TSH and T4, added T3 and TPO and the other antibody tests described above: TGAb, TRab, TSI. This would confirm subclinical hyperthyroidism and Graves’ as the likely source.

     

  • Do I need treatment, since the guidelines generally don’t suggest treatment with normal T3/T4 and TSH between .1 and .4?Initially he suggested treatment would be an option, and after the repeat and expanded lab work, left it up to my decision. Given my symptoms that are actively bothering me, I’m choosing to try low-dose antithyroid medication.
  • For hyperthyroidism treatment, beta blockers seem to be part of treatment guidelines for managing symptoms in the short-term, since it takes ~6 weeks for antithyroid medication to show up in lab results. Were beta blockers warranted in my case?My endo typically doesn’t like to prescribe beta blockers unless there are extreme symptoms. He gave an example of someone with a T4 (I think) around 10 and extreme visible shaking. He left it up to me, but his opinion was the side effects, such as lethargy, would outweigh the benefits for mild symptoms, so it is better to treat the root cause. I agreed and did not ask for a beta blocker prescription.
  • I also asked if a DEXA scan was warranted to check my bone density.I haven’t had one in over a decade, and celiac and EPI and now Graves’ puts me at possible higher risk of bone density issues. And, since the presence of osteoporosis changes the treatment recommendation for subclinical hyperthyroidism, we agreed it was worth doing. I have it scheduled in a few weeks. My last one over a decade ago was normal.
  • Finally, I asked about my eye care, now that I have a known eye thing (Graves’ orbitopathy). Do I need to get referred to an ophthalmologist, or can I continue to see my existing optometrist for annual eye care (including diabetes eye exam) and contact fittings?My endocrinologist suggested that my optometrist can continue to manage my eye care, unless something changes significantly. Ophthalmologists, based on his response and my research, seem to handle severe eye disease treatments that aren’t likely warranted for me. I’ll probably need supportive eye care (e.g. gel drops, regular eye drops) for now. However, I’m planning to send a note to my eye doctor and flag that I want to talk about Graves’ eye things and a plan for monitoring severity and progression over time, and check whether she’s comfortable supporting me or if she prefers to refer me to someone else. 


After my repeat labs came back, my endocrinologist messaged me to confirm things and ask if I wanted him to send in the prescription as previously discussed. This exchanged answered the additional questions I had at this time:

  • What is the treatment timeline? How soon might I see results?He suggested repeat labs at the 2 month mark. Ideally, we’d see reduced antibody levels and my hope is that my eye symptoms will have also improved and/or I won’t have any additional weeks without being able to wear contacts.

    Given I have a clear impact to my heart rate, I’m hypothesizing that I might see changes to the trend in my heart rate data sooner than 6 weeks – 2 months, so that’ll be interesting to track!

     

  • Side effects?Common side effects with antithyroid drugs are rash/allergic type response, headache, or agranulocytosis. He told me to discontinue and contact the office if I had any of those symptoms.

    He didn’t go into detail, but I’ve read about agranulocytosis and it seems like if you have a fever and strong sore throat, you need to discontinue and probably will have blood work ordered to make sure your white blood cell counts are ok. Don’t google too much on this one as it sounds scary, but it’s also rare – less than 2% of people seem to have this.

     

  • The only question he didn’t answer was whether it makes a difference in efficacy to take the antithyroid drugs at night or in the morning.Probably, the answer is it doesn’t matter, and whatever time you can take it consistently is best. However, I want to optimize and get the best results from taking this, so I’m bummed that there doesn’t seem to be any evidence (let me know if you’ve found anything in medical literature) suggesting how to optimize timing of it. 

So that’s where I am today.

I now have type 1 diabetes, celiac disease, exocrine pancreatic insufficiency, and Graves’ disease (contributing to subclinical hyperthyroidism). It’s possible that we can fix the subclinical hyperthyroidism, and that I won’t need to be on antithyroid medication long-term. However, the data for those of us with Graves’ orbitopathy isn’t super optimistic compared to those without Graves’ eye disease; so I am managing my expectations that managing my thyroid antibody and hormone levels will be an ongoing thing that I get to do along with managing insulin and blood sugars and managing pancreatic enzymes. We’ll see!

New Research on Glycemic Variability Assessment In Exocrine Pancreatic Insufficiency (EPI) and Type 1 Diabetes

I am very excited to share that a new article I wrote was just published, looking at glycemic variability in data from before and after pancreatic enzyme replacement therapy (PERT) was started in someone with type 1 diabetes with newly discovered exocrine pancreatic insufficiency (EPI or PEI).

If you’re not aware of exocrine pancreatic insufficiency, it occurs when the pancreas no longer produces the amount of enzymes necessary to fully digest food. If that occurs, people need supplementary enzymes, known as pancreatic enzyme replacement therapy (PERT), to help them digest their food. (You can read more about EPI here, and I have also written other posts about EPI that you can find at DIYPS.org/EPI.)

But, like MANY medications, when someone with type 1 diabetes or other types of insulin-requiring diabetes starts taking them, there is little to no guidance about whether these medications will change their insulin sensitivity or otherwise impact their blood glucose levels. No guidance, because there are no studies! In part, this may be because of the limited tools available at the time these medications were tested and approved for their current usage. Also this is likely in part because people with diabetes make up a small fraction of the study participants that most of these medications are tested on. If there are any specific studies on the medications in people with diabetes, these studies likely were done before CGM, so little data is available that is actionable.

As a result, the opportunity came up to review someone’s data who happened to have blood glucose data from a continuous glucose monitor (CGM) as well as a log of what was eaten (carbohydrate entries) prior to commencing pancreatic enzyme replacement therapy. The tracking continued after commencing PERT and was expanded to also include fat and protein entries. As a result, there was a useful dataset to compare the impacts of pancreatic enzyme replacement therapy on blood glucose outcomes and specifically, looking at glycemic variability changes!

(You can read an author copy here of the full paper and also see the supplementary material here, and the DOI for the paper is https://doi.org/10.1177/19322968221108414 . Otherwise, below is my summary of what we did and the results!)

In addition to the above background, it’s worth noting that Type 1 diabetes is known to be associated with EPI. In upwards of 40% of people with Type 1 diabetes, elastase levels are lowered, which in other cases is correlated with EPI. However, in T1D, there is some confusion as to whether this is always the case or not. Based on recent discussions with endocrinologists who treat patients with T1D and EPI (and have patients with lowered elastase that they think don’t have EPI), I don’t think there have been enough studies looking at the right things to assess whether people with T1D and lowered elastase levels would benefit from PERT and thus have EPI. More on this in the future!

Because we now have technology such as AID (automated insulin delivery) and CGM, it’s possible to evaluate things beyond simple metrics of “average blood sugar” or “A1c” in response to taking new medications. In this paper, we looked at some basic metrics like average blood sugar and percent time in range (TIR), but we also did quite a few calculations of variables that tell us more about the level of variability in glucose levels, especially in the time frames after meals.

Methods

This person had tracked carb entries through an open source AID system, and so carb entries and BG data were available from before they started PERT. We call this “pre-PERT”, and selected 4 weeks worth of data to exclude major holidays (as diet is known to vary quite a bit during those times). We then compared this to “post-PERT”, the first 4 weeks after the person started PERT. The post-PERT data not only included BGs and carb entries, but also had fat and protein entries as well as PERT data. Each time frame included 13,975 BG data points.

We used a series of open source tools to get the data (Nightscout -> Nightscout Data Transfer Tool -> Open Humans) and process the data (my favorite Unzip-Zip-CSVify-OpenHumans-data.sh script).

All of our code for this paper is open source, too! Check it out here. We analyzed time in range, TIR 70-180, time out of range, TOR >180, time below range, TBR <70 and <54, the number of hyperglycemic excursions >180. We also calculated total daily dose of insulin, average carbohydrate intake, and average carbohydrate entries per day. Then we calculated a series of variability related metrics such as Low Blood Glucose Index (LBGI), High Blood Glucose Index (HBGI), Coefficient of Variation (CV), Standard Deviation (SD), and J_index (which stresses both the importance of the mean level and variability of glycemic levels).

Results

This person already had an above-goal TIR. Standard of care goal for TIR is >70%; before PERT they had 92.12% TIR and after PERT it was 93.70%. Remember, this person is using an open source AID! TBR <54 did not change significantly, TBR <70 decreased slightly, and TOR >180 also decreased slightly.

More noticeably, the total number of unique excursions above 180 dropped from 40 (in the 4 weeks without PERT) to 26 (in 4 weeks when using PERT).

The paper itself has a few more details about average fat, protein, and carb intake and any changes. Total daily insulin was relatively similar, carb intake decreased slightly post-PERT but was trending back upward by the end of the 4 weeks. This is likely an artifact of being careful to adjust to PERT and dose effectively for PERT. The number of meals decreased but the average carb entry per meal increased, too.

What I find really interesting is the assessment we did on variability, overall and looking at specific meal times. The breakfast meal was identical during both time periods, and this is where you can really SEE visible changes pre- and post-PERT. Figure 2 (displayed below), shows the difference in the rate of change frequency. There’s less of the higher rate of changes (red) post-PERT than there is from pre-PERT (blue).

Figure 2 from GV analysis on EPI, showing lower frequency of high rate of change post-PERT

Similarly, figure 3 from the paper shows all glucose data pre- and post-PERT, and you can see the fewer excursions >180 (blue dotted line) in the post-PERT glucose data.

Figure 3 from GV analysis paper on EPI showing lower number of excursions above 180 mg/dL

Table 1 in the paper has all the raw data, and Figure 1 plots the most relevant graphs side by side so you can see pre- and post-PERT before and after after all meals on the left, versus pre and post-PERT before and after breakfast only. Look at TOR >180 and the reduction in post-breakfast levels after PERT! Similarly, HBGI post-PERT after-breakfast is noticeably different than HBGI pre-PERT after-breakfast.

Here’s a look at the HBGI for breakfast only, I’ve highlighted in purple the comparison after breakfast for pre- and post-PERT:

High Blood Glucose Index (HBGI) pre- and post-PERT for breakfast only, showing reduction in post-PERT after breakfast

Discussion

This is a paper looking at n=1 data, but it’s not really about the n=1 here. (See the awesome limitation section for more detail, where I point out it’s n=1, it’s not a clinical study, the person has ‘moderate’ EPI, there wasn’t fat/protein data from pre-PERT, it may not be representative of all people with diabetes with EPI or EPI in general.)

What this paper is about is illustrating the types of analyses that are possible, if only we would capture and analyze the data. There are gaping holes in the scientific knowledge base: unanswered and even unasked questions about what happens to blood glucose with various medications, and this data can help answer them! This data shows minimal changes to TIR but visible and significant changes to post-meal glycemic variability (especially after breakfast!). Someone who had a lower TIR or wasn’t using an open source AID may have more obvious changes in TIR following PERT commencement.

This paper shows several ways we can more easily detect efficacy of new-onset medications, whether it is enzymes for PERT or other commonly used medications for people with diabetes.

For example, we could do a similar study with metformin, looking at early changes in glycemic variability in people newly prescribed metformin. Wouldn’t it be great, as a person with diabetes, to be able to more quickly resolve the uncertainty of “is this even working?!” and not have to suffer through potential side effects for 3-6 months or longer waiting for an A1c lab test to verify whether the metformin is having the intended effects?

Specifically with regards to EPI, it can be hard for some people to tell if PERT “is working”, because they’re asymptomatic, they are relying on lab data for changes in fat soluble vitamin levels (which may take time to change following PERT commencement), etc. It can also be hard to get the dosing “right”, and there is little guidance around titrating in general, and no studies have looked at titration based on macronutrient intake, which is something else that I’m working on. So, having a method such as these types of GV analysis even for a person without diabetes who has newly discovered EPI might be beneficial: GV changes could be an earlier indicator of PERT efficacy and serve as encouragement for individuals with EPI to continue PERT titration and arrive at optimal dosing.

Conclusion

As I wrote in the paper:

It is possible to use glycemic variability to assess changes in glycemic outcomes in response to new-onset medications, such as pancreatic enzyme replacement therapy (PERT) in people with exocrine pancreatic insufficiency (EPI) and insulin-requiring diabetes. More studies should use AID and CGM data to assess changes in glycemic outcomes and variability to add to the knowledge base of how medications affect glucose levels for people with diabetes. Specifically, this n=1 data analysis demonstrates that glycemic variability can be useful for assessing post-PERT response in someone with suspected or newly diagnosed EPI and provide additional data points regarding the efficacy of PERT titration over time.

I’m super excited to continue this work and use all available datasets to help answer more questions about PERT titration and efficacy, changes to glycemic variability, and anything else we can learn. For this study, I collaborated with the phenomenal Arsalan Shahid, who serves as technology solutions lead at CeADAR (Ireland’s Centre for Applied AI at University College Dublin), who helped make this study and paper possible. We’re looking for additional collaborators, though, so feel free to reach out if you are interested in working on similar efforts or any other research studies related to EPI!

Looking back at work and accomplishments in 2021

I decided to do a look back at the last year’s worth of work, in part because it was a(nother) weird year in the world and also because, if you’re interested in my work, unless you read every single Tweet, there may have been a few things you missed that are of interest!

In general, I set goals every year that stretch across personal and professional efforts. This includes a daily physical activity streak that coincides with my walking and running lots of miles this year in pursuit of my second marathon and first (50k) ultramarathon. It’s good for my mental and physical health, which is why I post almost daily updates to help keep myself accountable. I also set goals like “do something creative” which could be personal (last year, knitting a new niece a purple baby blanket ticked the box on this goal!) or professional. This year, it was primarily professional creativity that accomplished this goal (more on that below).

Here’s some specifics about goals I accomplished:

RUNNING

  • My initial goal was training ‘consistently and better’ than I did for my first marathon, with 400 miles as my stretch goal if I was successfully training for the marathon. (Otherwise, 200 miles for the year would be the goal without a marathon.) My biggest-ever running year in 2013 with my first marathon was 356 miles, so that was a good big goal for me. I achieved it in June!
  • I completed my second marathon in July, and PR’d by over half an hour.
  • I completed my first-ever ultramarathon, a 50k!
  • I re-set my mileage goal after achieving 400 miles..to 500..600…etc. I ultimately achieved the biggest-ever mileage goal I’ve ever hit and think I ever will hit: I ran 1,000 miles in a single year!
  • I wrote lots of details about my methods of running (primarily, run/walking) and running with diabetes here. If you’re looking for someone to cheer you on as you set a goal for daily activity, like walking, or learning to run, or returning to running…DM or @ me on Twitter (@DanaMLewis). I love to cheer people on as they work toward their activity goals! It helps keep me inspired, too, to keep aiming at my own goals.

CREATIVITY

  • My efforts to be creative were primarily on the professional side this year. The “Convening The Center” project ended up having 2 out of 3 of my things that I categorized as being creative. The first was the design of the digital activities and the experience of CTC overall (more about that here). The second were the items in the physical “kit” we mailed out to participants: we brainstormed and created custom playing cards and physical custom keychains. They were really fun to make, especially in partnership with our excellent project artist, Rebeka Ryvola, who did the actual design work!
  • My third “creative” endeavor was a presentation, but it was unlike the presentations I usually give. I was tasked to create a presentation that was “visually engaging” and would not involve showing my face in the presentation. I’ve linked to the video below in the presentation section, but it was a lot of work to think about how to create a visually and auditory focused presentation and try to make it engaging, and I’m proud of how it turned out!

RESEARCH AND PUBLICATIONS

  • This is where the bulk of my professional work sits right now. I continue to be a PI on the CREATE trial, the world’s first randomized control trial assessing open-source automated insulin delivery technology, including the algorithm Scott and I dreamed up and that I have been using every day for the past 7 years. The first data from the trial itself is forthcoming in 2022. 
  • Convening The Center also was a grant-funded project that we turned into research with a publication that we submitted, assessing more of what patients “do”, which is typically not assessed by researchers and those looking at patient engagement in research or innovation. Hopefully, the publication of the research article we just submitted will become a 2022 milestone! In the meantime, you can read our report from the project here (https://bit.ly/305iQ1W ), as this grant-funded project is now completed.
  • Goal-wise, I aim to generate a few publications every year. I do not work for any organization and I am not an academic. However, I come from a communications background and see the benefit of reaching different audiences where they are, which is why I write blog posts for the patient community and also seek to disseminate knowledge to the research and clinical communities through traditional peer-reviewed literature. You can see past years’ research articulated on my research page (DIYPS.org/research), but here’s a highlight of some of the 2021 publications:
  • Also, although I’m not a traditional academic researcher, I also participate in the peer review process and frequently get asked to peer-review submitted articles to a variety of journals. I skimmed my email and it looks like I completed (at least) 13 peer reviews, most of which included also reviewing subsequent revisions of those submitted articles. So it looks like my rate of peer reviewing (currently) is matching my rate of publishing. I typically get asked to review articles related to open-source or DIY diabetes technology (OpenAPS, AndroidAPS, Loop, Nightscout, and other efforts), citizen science in healthcare, patient-led research or patient engagement in research, digital health, and diabetes data science. If you’re submitting articles on that topic, you’re welcome to recommend me as a potential reviewer.

PRESENTATIONS

  • I continued to give a lot of virtual presentations this year, such as at conferences like the “Insulin100” celebration conference (you can see the copy I recorded of my conference presentation here). I keynoted at the European Patients Forum Congress as well as at ADA’s Precision Diabetes Medicine 2021; an invited talk ADA Scientific Sessions (session coverage here); the 2021 Federal Wearables Summit: (video here); and the BIH Clinician Scientist Symposium (video here), to name a few (but not all).
  • Additionally, as I mentioned, one of the presentations I’m most proud of was created for the Fall 2021 #DData Exchange event:

OTHER STUFF

I did quite a few other small projects that don’t fit neatly into the above categories.

One final thing I’m excited to share is that also in 2021, Amazon came out with a beta program for producing hardcover/hardback books, alongside the ability to print paperback books on demand (and of course Kindle). So, you can now buy a copy of my book about Automated Insulin Delivery: How artificial pancreas “closed loop” systems can aid you in living with diabetes in paperback, hardback, or on Kindle. (You can also, still, read it 100% for free online via your phone or desktop at ArtificialPancreasBook.com, or download a PDF for free to read on your device of choice. Thousands of people have downloaded the PDF!)

Now available in hardcover, the book about Automated Insulin Delivery by Dana M. Lewis

What we learned from “Convening The Center”

Like our previous RWJF-funded project, “Opening Pathways”, where we took time to reflect at the end of the project and also openly shared our grant-end narrative report that we submit to RWJF, John Harlow and I wanted to also share the grant-end narrative report that we created for RWJF for the Convening The Center project. The questions are based on their template. If you have any other questions about the Convening The Center project (background about it here), please do ask!

  1. What was the goal of your project? Do you have measures of your performance?

Our original goal was to convene THE center of healthcare, which means patients and caregivers and those working to effect change in the healthcare system from the ‘outside’. We originally planned for an all-expenses paid in-person physical meeting, gathering people from within the U.S. at a central location that would be relatively easy (within 2-3 hours of flying) to travel to for most individual participants. We aimed to gather 25 participants.

However, we were awarded our grant in December 2019 and saw the impact of COVID-19 early on in our communities (especially PI Lewis’s community of Seattle, where COVID-19 was first detected in the US in late January/early February 2020), and knew we would need to postpone the physical meeting from 2020 to at least spring 2021 at the earliest. As months passed, we realized the pandemic would not in fact be ‘over’, and debated between cancelling the grant or converting to a digital experience. We did not want to lose the opportunity to gather this type of community, and chose to switch to a digital meeting.

We spent significant amounts of time considering how to achieve the goals of our meeting (bringing together 25 people who didn’t necessarily know each other or have shared goals, beyond a broad overarching goal of improving healthcare, and giving them space to connect without forcing an agenda upon them). We ultimately decided to make our digital meeting a three-phase “experience:”

  • The first phase would involve one-to-one conversations that would allow us to deeply listen and understand the perspectives of each participant. We would use a visual notetaker to illustrate their story and work as a way to reflect back what we heard, as well as offer the artwork as a gift to participants as a thank you for sharing their experiences with us. These conversations would then shape the following phases.
  • The second phase was small-group conversations of up to 8 people maximum, which we chose based on a combination of availability and ensuring a mixed group of participants where there wasn’t necessarily one person or personality that would dominate a group conversation. There was no agenda, but we used Google Slides with some introductory activities to help people introduce themselves or their work in a non-threatening way, and facilitated topics of conversation for the group to dive into. We had four total groups in phase 2. We again had visual notetaking to represent each group’s conversation.
  • The third phase was a single meeting with all 25 participants present. We chose a mix of small group breakouts, based on thematic topics that were discussed in phase 2 and voted upon by participants; as well as providing a small group mix based on people they had not yet met in previous groupings; and also small groups based on affinity groups that the PI/Co-PI selected based on what we learned of people’s work in phase 1-2. After the rounds of breakouts, the group returned together for a discussion with all 25 participants based on whatever topic they wished to discuss.

And, at the end of the project we had $9,000 USD remaining as a result of the pivot to a digital meeting. We decided to select nine individuals (through additional public recruitment) for “internet scholarships”, to continue to address the needs of this community. We successfully selected 9 recipients who each accepted the scholarship.

The project overall was a success.

  • We were able to convene 25 participants from around the world and allow them to discuss whatever topics were most important to them.
  • Because we went digital/virtual, we were able to facilitate participation from non-US based participants which greatly enriched the discussions.
  • Participants consistently communicated surprise and delight after each phase of the project regarding how well they felt listened to, respected, and treated during the experience.
  • We used a visual notetaker as a subcontractor, and her work was a critical factor of our success. Rebeka Ryvola is an experienced conference visual notetaker and artist, and although she had not previously worked in healthcare, her ability to listen to a deeply technical healthcare conversation and reflect high level themes from individual stories as well as across a diverse group of participants is unparalleled. Her art as an artifact of each discussion was critical for allowing participants to feel heard and respected, as well as providing a way to introduce themselves to each other within the cohort.
  • Rebeka’s art for the individuals in phase 1 as well as the Phase 2 and Phase 3 pieces of art is already being widely shared and touted.
  • All 9 selected recipients of the internet scholarships accepted them.
  1. Do you have any stories that capture the impact of this project?

    One of our goals was to pay people for their time. Patients and caregivers are seldom paid for their time and expertise, although they offer invaluable expertise and solutions for improving healthcare.One individual, a parent with their own health situation as well as a parent of children with their own health situations, had served on a hospital advisory committee and numerous projects. However, until Convening The Center, this individual had never been paid for their time or work. They mentioned this numerous times throughout the project, almost in disbelief, that they were being paid for the first time for this type of time commitment. It was almost embarrassing to us for being the first people to pay them for their time on a project, although we are grateful for the resources of this grant that enabled us to pay each participant for their time.

    In general, while we as PI/Co-PI know the power of bringing people together through social media and virtually, and we expected many of the participants (by virtue of finding this project) were already connected to numerous patient communities or organizations, we were surprised by the number of comments that participants made about the power of this convening. Two quotes stuck out to us, from an experienced patient advocate and from a newer patient advocate:

  • “Getting to meet you all, truly made me feel not alone in what often feels overwhelming and hard.”
  • [It was powerful] “bringing so many people from all corners together. I’m still building my confidence as a speaker and these opportunities to connect in a Round Robin sort of way was impactful, for someone who is still finding their voice as an advocate”(See Appendix at end for additional stories!)
  1. Did RWJF assist or hinder your project in any way?

RWJF assisted immensely by allowing us to submit a re-budget request and allowing us to shift to a virtual meeting while maintaining the existing level of budget. This was significant, because had we originally submitted a proposal for a virtual meeting, I think the grant would have been rejected/not awarded. Or, it may have been awarded with a significantly lower budget amount.

However, keeping the level of budget allowed us to spend significant amounts of time designing an inclusive, immersive digital experience that allowed us to bridge the participants’ physical worlds with our virtual meeting. We were able to do this by designing a “kit” to send to each participant, including international participants, with thoughtfully designed and curated items to aid them in their participation in this project. A typical virtual meeting would not have supported the budget for this type of ‘kit’ nor the PI/Co-PI’s increased time to design a thoughtful, effective, inclusive virtual meeting.

It also allowed us to facilitate the inclusion of participants from around the world. With a physical meeting, we were limited in budget to only US participants because of the travel cost variance with international travel. We were able to include participants from Costa Rica, Sweden, India, Pakistan, as well as across the US. We were also able to reach more diverse, under-resourced (including under-funded and under-included), and often minority perspective community members who maybe would not have been able to participate without it being virtual – even with us paying for their time and travel, because of their other family or community commitments.

Finally, because we went to a virtual experience and chose to do three ‘phases’ to build up to the final meeting, rather than a one-day in person meeting, we were able to get to know each participant and build trust over the phases that would not have happened by dropping 25 people into a room together for a physical meeting.

As a result, the permission and support with the same budget to shift to a virtual meeting greatly enriched the experience beyond what we would have originally predicted, and we hope RWJF considers this moving forward when thinking about facilitating similar gatherings of communities or projects.

Specifically within RWJF, our project manager Paul Tarini was helpful as always throughout the project. When we chose to pivot to a virtual meeting, we asked him for his perspective on thoughtful digital gatherings, and he shared not only his own experiences but also introduced us to a number of other RWJF grantees or collaborators to help us research best practices for online engagement for conferences and meetings. Many of the ideas we learned from collaborators such as New Public ended up shaping the phases of our work.

  1. If the project encountered internal or external challenges, how did they affect the project and how did you address them? Was there something RWJF could have done to assist you?

Our main challenges were the COVID-19 pandemic and the timing overall for our grant, because the primary goal was hosting a physical in-person meeting, Per the above section, RWJF assisted us by allowing us to re-budget from a physical in-person meeting to a digital gathering, while permitting the same overall level of budget. This was crucial for our success, because simply hosting a one-time 25 person meeting would not have achieved the goal without the additional design work that was done.

  1. Has your organization received funding from other foundations, corporations or government bodies for the project RWJF has been supporting?

No.

  1. When considering the design and implementation of this project, what lessons did you learn that might help other grantees implement similar work in this field?

We learned quite a lot regarding designing digital experiences that we hope other grantees will be able to leverage, and we hope RWJF will take this feedback into consideration and support other future projects that host virtual convenings.

For example, we learned that it takes more time to design impactful virtual gatherings that are not ‘just another zoom’. It takes design of the meeting itself with a clear ‘run of show’ or agenda, as well as clear pre-communication to participants about what to expect and how the meeting or gathering will go. In some cases, such as for our project, we also found it necessary to break the gathering up into multiple stages, to allow us to get to know participants and build trust to have the open, thoughtful discussions that emerged in phase 2 and 3. Had we simply plopped 25 people together in a virtual meeting as a one-off, it would not have been successful. We also were cognizant of the demand on participants in terms of overall time commitment – people don’t have the stamina for more than 2 hours on a video call – and the demands on internet bandwidth and personal energy for requesting a video call for that time period. We chose max 2 hours for each phase, and encouraged people to choose for themselves whether they had video on or off. We also designed activities to facilitate trust and comfort in the digital environment.

As a result, we learned that going from individual conversations to small group to larger conversations worked well for establishing safe spaces for open conversations. This also enabled relationships to begin growing throughout the project and not only after the ‘main event’ of phase 3. This facilitated the network within the cohort that began to grow as a community. You can’t force a community by dumping people in a place, but you can create a space and facilitate interactions that lead to relationship and network growth, and ultimately a community did evolve.

We also ended up developing a physical ‘kit’ to send to participants. It included a variety of useful items (such as a device cleaning cloth and a device stand, since many people are spending increased amounts of time on devices during the pandemic as well as we were asking them to spend more time on devices for this project). We also custom designed a few special items to honor people’s participation in the project. One of these items was a pack of playing cards that they could give to family or the people supporting them to help them be able to make the space for participating in the project. We also created a custom CTC keychain and provided several additional keychains that each participant could gift to others to honor other advocates, clinicians, and “doers” in the healthcare space who have helped them in their journey or that they want to honor their work. We hoped these keychains would also serve as a memento of their time in the project and be something they could physically hold in the future to give them strength, if they need it. This kit also included a whiteboard and markers, which we used in a variety of ways throughout the project including holding up to show something on screen, which we aimed to tie the offline/online experiences together. We didn’t want to send people “junk” “swag” that would end up in a landfill, and so we included things that we thought would be used by everyone in the cohort and had meaningful ties to the project.

Overall, one of our key design principles was to consistently signal that our gathering was and would be different from random meetings and conferences where people show up, say the same thing, and leave unchanged. We aimed to achieve this by doing everything different, from paying participants, to surprising people with their CTC ‘kit’, and to providing the visual note art as a gift after phase 1 in addition to doing visual notetaking from phase 2 and phase 3 as well. We consistently heard surprise and delight from participants beyond what you would typically receive from participants at a meeting or a conference, so we believe all of these elements of doing a gathering differently were successful, and that “surprise and delight” is an effective design principle for building relationships, creating spaces, and encouraging participation.

  1. What impact do you think the project has had to date?

The project was impactful in and of itself by successfully gathering 25 diverse individuals who have not previously had the opportunity to gather without an agenda forced upon them. Additionally, we were successful by paying each and every participant for their time. (Several individuals had never been paid before for their contributions to meetings, conferences, advisory committees, and/or research projects.)

In addition, it was successful for creating connections to enable network development and growth of relationships for people who don’t have traditional ‘professional development resources’ but benefit greatly from seeing other people ‘like them’ who are working to improve healthcare from the outside.

Through this project, people were able to surface similar challenges and experiences among individuals who felt isolated and ‘lonely’ in their work. They also were able to recognize shared challenges and solutions across disease areas, when they previously were not aware of resources. One example is a participant who shared research advocate training program materials from a specific cancer community, with other participants planning to leverage or mirror those resources in other disease spaces.

Additionally, participants began recognizing similarities across disease communities, with consistent gaps around areas such as transitioning out of pediatric to (young) adult care; lack of inclusivity with established advocacy organizations and online communities; and challenges with interacting with healthcare providers.

As PI/Co-PI we have also developed a novel framework for mapping the efforts of individuals by convening the center of health and healthcare. This is an innovative framework that assesses a spectrum of patient experiences based on what patients do when they go beyond navigating their personal or individual level of lived healthcare experiences and transition toward community or systemic level involvement. We have written up this framework and the results of thematic discussions from CTC in a research article, which we plan to submit to a peer-reviewed publication (and then share here soon!). We hope to inspire further work with this proposed model for facilitating improved matching between individuals and their current or future levels of interest and involvement with researchers, advocacy organizations, and other opportunities.

  1. What are post-grant plans for the project, if it does not conclude with the grant?

No specific plans, as the project technically concludes with the end of the grant.

However, many individuals who participated in this project are planning to work together in the future. For example, several post-meeting meetings have already happened among small groups within the cohort. One such meeting involved a discussion around patient-led research publications and strategy for utilizing blog posts and mainstream media compared to academic journals and traditional research conferences as methods of dissemination of patient community knowledge.

  1. With a perspective on the entire project, what were its most effective communications and advocacy approaches, its key publications, and its national/regional communications activities?

Our most effective communication was through social media. We publicized the project via a blog post shared across Facebook, Twitter, and LinkedIn. It was successful as measured by receiving applications from >60% of individuals that the PI did not recognize the name. From within the selected cohort, there were ~75% unknown participants to the PI/Co-PI, which indicated success in outreach to new networks and communities.

We believe the most effective advocacy approach was empowering individual participants. This project was not about name recognition of the project itself, but we believe by surprising and delighting participants and giving them a positive experience in the project, the ripple effects of this project and RWJF’s funding will continue to be felt for years to come.

APPENDIX:

We shared a draft version of this report with participants of the Convening The Center Cohort, asking for any additional feedback and stories we should include. The following stories and comments were shared as a result:

  1. “I appreciate how you have effectively captured the essence of our Convening The Center experiences. Surprise and delight are positive reinforcements and pragmatic concepts that can catalyze trust leading to trustworthiness; and overall the gatherings were very beneficial in developing a community of individuals who had similar interests with advancing patient and caregiver engagement. I do believe we were each pleased with the concrete extras including; fair compensation, bio-‘art’ifacts, CTC shareable reminders and reflected stories that we each will carry forward. The three tiered model was an effective method allowing for Conveners to listen and learn from each other.”
  2. “I think you captured the essence of my personal experience (I can’t/won’t/shouldn’t speak to the experiences of the others). The only thing I have to say is a hearty thank you to RWJF for allowing this project to proceed virtually. It was an enriching experience, filled with far more diversity (as you pointed out).”
  3. “Many thanks to CTC & grantor RWJF for allowing the power of the pivot to take place!

    Do you have any stories that capture the impact of this project?

    I would add that this experience presented an opportunity to amplify voices of women of color. This group was accepting of my perspective and participating in it further ignited my passion to embrace my efforts as an advocate for an underserved patient population.

    What impact do you think the project has had to date?

    The project inspired me to challenge old ideas of self-doubt and redefine what advocacy means to me. Since the convening, I’ve been empowered to participate in projects that bring forth HPV, Cervical, & Gynecologic Cancer awareness for the Black-Hispanic population. This was a huge moment of growth and development for someone who struggles with social anxiety.

    When considering the design and implementation of this project, what lessons did you learn that might help other grantees implement similar work in this field

    I just wished to add, if others would like to duplicate a similar idea in a virtual capacity, it is important to have systems in place that allow for free flowing communication. This was my first time using Slack and it performed well in my opinion. The platform could be accessed on both pc or mobile device.

    I always felt connected & well-informed. The [Slack] app made it easy to contribute to the discussion with the group throughout the entire project. It also presented the opportunity for members to learn more about one another through introductions and our artwork; all prior to meeting each other virtually.”


A huge thank you to each participant who was a part of Convening The Center!

 

New Convening The Center Update – Help Us Find People Who Could Use Internet Scholarships to Do Good In Healthcare?

You may have previously read a blog post about Convening The Center, a RWJF-grant-funded project with the aim of bringing together 25 diverse individuals who are working to change healthcare in nontraditional ways. The main part of the CTC project has finished (more about that soon!), but we also realized that we had a little bit of budget left over from the project, and pitched to RWJF a new plan to use the remaining funds.

We want to give individuals working to make a difference in health and healthcare – and the health of their (online, geographic, or disease) communities – by providing 9 internet scholarships of $1,000 USD each. This is estimated to cover about a year’s worth of internet access for each individual. Individuals who are applying should be able to articulate their past, current, or future efforts as it relates to making a difference in health/care.

There are no strings attached to this ‘internet scholarship.’ You don’t have to do anything particular, or commit to any projects if you’re selected, other than write us a few (say, 250 or so) words within the next year to let us know what it meant to you to have your internet paid for. That’s it. This feedback (which can be given privately to us, or posted publicly – your call) is the only requirement for receiving these funds.

Can you help us find people who could use Internet scholarships to do good in healthcare?

Why are we doing this?

We learned (and re-learned) from working with the cohort from the original CTC project that internet access is something many of us take for granted, and that we shouldn’t. Many of us may assume, from a privileged position, that access to high speed internet is table stakes and that everyone has it, so when invited to take a seat at the table, anyone invited could get there. But that’s not the case.

This is relevant to the space we are working in with CTC, where we are seeking to support patients (people living with diseases) or carers who are working to improve healthcare and their communities, often from non-resourced settings. The ability to afford high-speed internet access therefore might be a barrier for enabling patients/carers to take a seat at the table, when invited – or from building their own table.

We realize that $9,000 won’t solve all the problems of equitable access and facilitate online participation of everyone who needs it. But it’s a start, and could be the thing that makes a difference for 9 individuals, and it’s the best use we can envision for this remaining budget.

So our ask, if you’re reading this:

  • Please consider nominating someone or applying (self-nominating) for the Convening The Center Internet Scholarship, by filling out this Google form by November 14.
  • Please share this blog post (https://bit.ly/CTC-Internet-Scholarships) with your online and offline networks, including with those you know in rural settings where internet cost may be a bigger barrier.

John and I are excited to facilitate this last use of our CTC project budget. We will close the nomination Google form on November 14; select recipients by the end of November; and aim to provide payments of the CTC Internet Scholarships (administered by Trailhead Institute, our fiscal sponsor) in early December (all 2021). Within the next year after we receive feedback from all participants, we will also (anonymously, at an aggregate level) share the feedback and what we learned from using the remaining budget funds for this purpose with the broader community, to help inform others who are looking to create similar initiatives in the future.

In summary:

  • Who: People who are looking to make a difference in health/care who might benefit from having a year’s worth of internet costs covered
  • What: Up to 9 individuals will receive $1,000 USD, estimated to cover a year’s worth of typical high speed internet plans.
  • How: fill out this Google form and nominate yourself or someone else. Multiple nominations are welcome, there is no limit.
  • When: Please apply by November 14, and recipients will be selected in November 2021.

Designing digital interactive activities that aren’t traditional icebreakers

A participant from Convening The Center recently emailed and asked what technology we had used for some of our interactive components within the phase 2 and 3 gatherings for the project. The short answer was “Google Slides” but there was a lot more that went into the choice of tech and the design of activities, so I ended up writing this blog post in case it was helpful to anyone else looking for ideas for interactive activities, new icebreakers for the digital era, etc.

Design context:

We held four small (8 people max) gatherings during “Phase 2” of CTC and one large (25 participants) gathering for “Phase 3”, and used Zoom as our videoconference platform of choice. But throughout the project, we knew we were bringing together random strangers to a meeting with no agenda (more about the project here, for background), and wanted to have ways to help people introduce themselves without relying on rote introductions that often fall back to name, title/organization (which often did not exist in this context!), or similar credentials.

We also had a few activities during the meeting where we wanted people to interact, and so the “icebreakers” (so to speak) were a low-stress way to introduce people to the types of activities we’d repeat later in the meeting.

Technology choice:

I’ve seen people use Jamboard (made by Google) for this purpose (icebreakers or introductory activities), and it was one that came to mind. However, I’ve been a participant on a Jamboard for a different type of meeting, and there are a few problems with it. There’s a limit to the number of participants; it requires participants to create the item they want to put on the board (e.g. figure out how to add a sticky note), and the examples I’ve seen content-wise ended up using it in a very binary way. That in some cases was due to the people designing the activity (more on content design, below), but given that we wanted to also use Google Slides to display information to participants and also enable notetaking in the same location, it also became easy to replicate the basic functionality in Google Slides instead. (PS – this article was helpful for comparing pros/cons of Jamboard and Google Slides.)

Content choices:

The “icebreakers” we chose served a few purposes. One, as mentioned above, was familiarizing people with the platform so we could use it for meeting-related activities. The other was the point of traditional icebreakers, which is to help everyone feel comfortable and also enable people to introduce themselves. That being said, most of the time introductions rely on credentials, and this was specifically a credential-less or non-credential-focused gathering, so we brainstormed quite a bit to think of what type of activities would allow people to get comfortable interacting with Google Slides and also introduce themselves in non-stressful ways.

The first activity we did for the small groups was a world map image and asked people to drag and drop their image to “if you could be anywhere in the world right now, where would you be?”. (I had asked all participants to send some kind of image in advance, and if they didn’t, supplied an image and told them what it was during the meeting.) I had the images lined up to the side of the map, and in this screenshot you can see the before and after from one of the groups where they dragged and dropped their images.

Visual of a world map with images representing individuals and different places they want to be in the world

The second activity was a slide where we asked everyone to type “one boring or uninteresting fact about themselves”. Again, this was a push back against traditional activities of “introduce yourself by credentials/past work” that feels performative and competitive. I had everyone’s names listed on the slide, so each could type in their fact. It ended up being a really fun discussion and we got to see people’s personalities early on! In some cases, we had people drop in images (see screenshot of example) when there was cross-cultural confusion about the name of something, such as the name of a vegetable that varies worldwide! (In this case, it was okra!)

List of people's names and a boring fact about themselves

We also did the same type of “type in” activity for “Ask me about my expertise in..” and asked people to share an expertise they have personally, or professionally. This is the closest we got to ‘traditional’ introductions but instead of being about titles and organizations it was about expertise in activities.

Finally, we did the activity most related to our meeting that I had wanted people to be comfortable with dragging and dropping their image for. We had a slide, again with everyone’s image present, and a variety of types of activities listed. We queried participants about “where do you spend most of your time now?”. Participants dragged and dropped their images accordingly. In some cases, they duplicated their image (right click, duplicate in Google Slides) to put themselves in multiple categories. We also had an “other” category listed where people could add additional core activities.

Example of slide activity where people drag their image to portray activities they're doing now and want to do in the future

Then, we had another slide asking where do they want to spend most of their time in the future? The point of this was to be able to switch back and forth between each slide and visualize the changes for group members – and also so they could see what types of activities their fellow participants might have experience in.

Some of these activities are similar to what you might do in person at meetings by “dot voting” on topics. This type of slide is a way to achieve the same type of interactivity digitally.

Facilitating or moderating these types of interactive activities

In addition to choosing and designing these activities, I also feel that moderating or facilitating these activities played a big role in the success of them for this project.

As I had mentioned in the technology choice section,  I’ve previously been a participant in other meeting-driven activities (using Jamboard or other tech) where the questions/activities were binary and unrelated to the meeting. Questions such as “are you a dog or cat person? Pick one.” or “Is a hot dog a sandwich?” are binary, and in some cases a meeting facilitator may fall into the trap of then ascribing characteristics to participants based on their response. In a meeting where you’re trying to use these activities to create a comfortable environment for participation amongst virtual strangers…that can backfire and actually cause people to shut down and limit participation in the meeting following those introductory activities.

As a result of having been on the receiving end of that experience, I really wanted to design activities with relevance to our meeting (both in terms of technology used and the content) as well as enough flexibility to support whatever level of involvement people wanted to do. That included being prepared to move people’s images or type in for them, especially if they were on the road and not able to sit stationary and use google slides. (We had recommended people be stationary for this meeting, but knew it wasn’t always possible, and were prepared to still help them verbally direct us to move their image, type in their fact, etc. This also can be very important for people with vision impairment as well, so be prepared to assist people in completing the activities for whatever reason, and also to verbally describe what is going on the slides/boards as people move things or type in their facts. This can aid those with vision impairment and also those who are on the go and can’t look at a screen during the meeting for whatever reason.)

One other reason we used Google Slides is so we’d end up with a slide for each breakout group to be able to take notes, and a “parking lot” slide at the end of the deck for people to add questions or comments they wanted to bring back up in the main group or moving forward in future discussions. Because people already had the Google Slide deck open for the activity, it was easy for them to scroll down and be in the notetaking slide for their breakout group (we colored the background of the slides, and told people they were in the purple, blue, green, etc. slides to make it easier to jump into the right slide).

One other note regarding facilitation with Zoom + Google Slides is that the chat feature in Zoom doesn’t show previous chat to people who join the Zoom meeting after that message is sent. So if you want to use Zoom chat to share the Google Slides link, have your link saved elsewhere and assign someone to copy and paste that message into the chat frequently, so all participants have access and can open the URL as they join the meeting. (This also includes if someone leaves and re-enters the meeting: you may need to re-post the link yet again into chat.)

TLDR, we used Google Slides to facilitate meeting note taking, digital “dot voting” and other interactive icebreaker activities alongside Zoom.

Update – 2021 Convening The Center!

2020 did not go exactly as planned, and that includes Convening the Center (see original announcement/plan here), which we had intended to be an awesome, in-person gathering of individuals who are new or have previous experience working to improve healthcare through advocacy, innovation, design, research, entrepreneurship, or some other category of “doing” and “fixing” problems they see for themselves and their community. But, as an early “I see COVID-19 is going to be a problem” person (see this post Scott and I posted March 7 begging people to stay home), by early February I was warning my co-PI and RWJF contacts that we would likely be postponing Convening the Center, and by May that was pretty clear. So we decided to request (and received) an extension on our grant from RWJF to enable us to push the grant into 2021…and ultimately, ::waves hand at everything still going on:: decided to shift to an all-virtual experience.

I’ll be honest – I was a little disappointed! But now, after several more months of work with John (Harlow, my Co-PI), I’m now very excited about the opportunities an all-virtual experience for Convening the Center will bring. First and foremost, although we planned to pay participants for ALL travel costs, hotel, food, AND for their time, I knew there would likely be people who would still not be able to travel to participate. I am hoping with a virtual experience (where we still pay people for their time!), the reduced time commitment to participate will enable those people to potentially participate.

Secondly, we’ve been thinking quite a bit about the design of virtual meetings and gatherings and have some ideas up our sleeve (which we’ll share as we finish developing them!) about how to achieve the goals of our gathering, online, without triggering video conference fatigue. If you’ve had any fantastic virtual experiences in 2020 (or ever), please let us know what they were, and what you loved (or what to avoid!), so that we can draw on as many inputs as possible to design this virtual experience.

Here’s what Convening the Center will now look like:

  • Starting now: recruitment. We are looking to solicit interest from individuals who are new or have some experience working to change or improve health, healthcare, communities, etc. If that’s you, please self-nominate yourself here, and/or please also consider sharing this with your communities or a friend from another community!
  • January: we will reach out to nominees with another short form to gather a bit more information to help us create the cohort.
  • Early February: we will notify selected participants.
  • February: Phase 1 (2 hours scheduled time commitment from participants, plus some asynchronous opportunities)
  • April: Phase 2 (2-4 hour schedule time commitment from participants, plus some asynchronous opportunities)
  • June: Phase 3 (2-4 hour scheduled time commitment from participants, plus some asynchronous opportunities)

We’ll be sharing more in the future about what the “phases” look like, and this virtual format will allow us to also invite participation from a broader group beyond the original cohort of participants. Stay tuned!

Again, here is the nomination link you can self-nominate or nominate others at. Thanks!

Nominate someone you know for Convening The Center!

How to deal with wildfire smoke and air quality issues during COVID-19

2020. What a year. We’ve been social distancing since late February and being very careful in terms of minimizing interactions even with family, for months. We haven’t traveled, we haven’t gone out to eat, and we basically only go out to get exercise (with a mask when it’s on hiking trails/around anyone) or Scott goes to the grocery store (n95 masked). We’ve been working on CoEpi (see CoEpi.org – an open source exposure notification app based on symptom reports) and staying on top of the scientific literature around COVID-19, regarding NPIs like distancing and masking; at-home diagnostics like temperature and pulse oximetry monitoring, prophylactics and treatments like zinc, quercetine, and even MMR vaccines; and the impact of ventilation and air quality on COVID-19 transmission and susceptibility.

And we live in Washington, so the focus on air quality got very real very quickly during this year’s wildfire season, where we had wildfires across the state of Washington, then got pummeled for over a week with hazardous levels of wildfire smoke coming up from Oregon and California to cover our existing smoke layer. But, one of our DIY air quality hacks for COVID-19 gave us a head start on air quality improvements for smoke-laden air, which I’ll describe below.

Here are various things we’ve gotten and have been using in our personal attempts to thwart COVID-19:

  • Finger pulse oximeter.
    • Just about any cheap pulse oximeter you can find is fine. The goal is to get an idea of your normal baseline oxygen rates. If you dip low, that might be a reason to go to urgent care or the ER or at least talk to your doctor about it. For me, I am typically 98-99% (mine doesn’t read higher than 99%), and my personal plan would be to talk to a healthcare provider if I was sick and started dropping below 94%.
  • Thermometer
    • Use any thermometer that you’ll actually use. I have previously used a no-touch thermometer that could read foreheads but found it varied widely and inconsistently, so I went back to an under the tongue thermometer and took my temperature for several months at different times to figure out my baselines. If sick or you have a suspected exposure, it’s good to be checking at different times of the day (people often have lower temps in the morning than in the evening, so knowing your daily differences may help you evaluate if you’re elevated for you or not).
    • Note: women with menstrual cycles may have changes related to this; such as lower baseline temps at the start of the cycle and having a temperature upswing around or after the mid-point in their cycle. But not all do. Also, certain medications or birth controls can impact basal temperatures, so be aware of that.
  • Originally, n95 masks with outlet valves.
    • Note: n95 masks with valves cannot be used by medical professionals, because the valves make them less effective for protecting others. (So don’t freak out at people who had a box of valved n95 masks from previous wildfire smoke seasons, as we did. Ahem.) 
    • We had a box we bought after previous years’ wildfire smoke, and they work well for us (in low-risk non-medical settings) for repeated use. They’re Scott’s go-to choice. If you’re in a setting where the outlet valve matters (indoors in a doctor’s/medical setting, or on a plane), you can easily pop a surgical/procedure mask over the valve to block the valve to protect others from your exhaust, while still getting good n95-level protection for yourself.
    • They were out of stock since February, but given the focus on n95 without valves for medical PPE, there have been a few boxes of n95 masks with outlet valves showing up online at silly prices ($7 per mask or so). But, kn95’s are a cheaper per mask option that are generally more available – see below.
    • (June 2021 note – they are back to reasonable prices, in the $1-2 range per mask on Amazon, and available again.)
  • kn95 masks.
    • kn95 masks are a different standard than US-rated n95; but they both block 95% of tiny (0.3 micron) particles. For non-medical usage, we consider them equivalent. But like n95, the fit is key.
    • We originally bought these kn95s, but the ear loops were quite big on me. (See below for options if this is the case on any you get.) They aren’t as hardy as the n95s with valves (above); the straps have broken off, tearing the mask, after about 4-5 long wears. That’s still worth it for them being $2-3 each (depending on how many you buy at a time) for me, but I’d always pack a spare mask (of any kind) just in case.
      • Option one to adjust ear loops: I loop them over my ponytail, making them head loops. This has been my favorite kn95 option because I get a great fit and a tight seal with this method.
      • Option two to adjust ear loops: tie knots in the ear loops
      • Option three to adjust ear loops: use things like this to tighten the ear loops
    • We also got a set of these kn95s. They don’t fit quite as well in terms of a tight face fit, but these actually work as ear loops (as designed), and I was able to wear this inside the house on the worst day of air quality.
  • Box fan with a filter to reduce COVID-19 particles in the air:
    • We read this story about using an existing AC air furnace filter on a box fan to help reduce the number of COVID-19 particles in the air. We already had a box fan, so we took one of our spare 20×20 filters and popped it on. I’m allergic to dust, cats (which we just got), trees, grass, etc, so I knew it would also help with regular allergens. There are different levels of filter – all the way up to HEPA filters – but we had MERV 12 so that’s what we used.
  • Phone/object UV sanitizer
    • We got a PhoneSoap Pro (in lavender, but there are other colors). Phones are germy, and being able to pop the phone in (plus keys or any other objects like credit cards or insurance cards that might have been handled by another human) to disinfect has been nice to have.
    • The Pro is done sanitizing in 5 minutes, vs the regular one takes 10 minutes. It’s not quite 2x the price as the non-pro, but I’ve found it to be worthwhile because otherwise, I would be impatient to get my phone back out. I usually pop my phone in it when I get home from my walk, and by the time I’m done washing my hands and all the steps of getting home, the phone is about or already done being sanitized.
  • Bonus (but not as useful to everyone as the above, and pricey): Oura ring
    • Scott and I also both got Oura rings. They are pricey, but every morning when we wake up we can see our lowest resting heart rate (RHR), heart rate variability (HRV), temperature deviations, and respiratory rate (RR). There have been studies showing that HRV, RHR, overnight temperature, and RR changes happen early in COVID-19 and other infections, which can give an early warning sign that you might be getting sick with something. That can be a good early warning sign (before you get to the point of being symptomatic and highly infectious) that you need to mask up and work from home/social distance/not interact with other people if you can help it. I find the data soothing, as I am used to using a lot of diabetes data on a daily and real-time basis (see also: invented an open source artificial pancreas). Due to price and level of interest in self-tracking data, this may not be a great tool for everyone.
    • Note this doesn’t tell you your temperature in real time, or present absolute values, but it’s helpful to see, and get warnings about, any concerning trends in your body temperature data. I’ve seen several anecdotal reports of this being used for early detection of COVID-19 infection and various types of relapses experienced by long-haulers.

And here are some things we’ve added to battle air quality during wildfire smoke season:

  • We were already running a box fan with a filter (see above for more details) for COVID-19 and allergen reduction; so we kept running it on high speed for smoke reduction.
    • Basic steps: get box fan, get a filter, and duct tape or strap it on. Doesn’t have to be cute, but it will help.
    • I run this on high speed during the day in my bedroom, and then on low speed overnight or sleep with earplugs in.
  • We already had a small air purifier for allergens, which we also kept running on high. This one hangs out in our guest bedroom/my office.
  • We caved and got a new, bigger air purifier, since we expect future years to be equally and unfortunately as smoky. This is the new air purifier we got. (Scott chose the 280i version that claims to cover 279 sq. ft.). It’s expensive, but given how miserable I was even inside the house with decent air quality thanks to my box fan and filter, little purifier, and our A/C filtered air… I consider it to be worth the investment.
    • We plugged it in and validated that with our A/C-filtered air combined with my little air purifier and the box fan with filter running on high, we already had ‘good’ air quality (but not excellent). We also stuck it out in the hallway to see what the hallway air quality was running – around 125 ug/m^3 – yikes. Turns out that was almost as high as the outside air, which is I’ve had to wear a kn95 mask even to walk hallway laps, and why my eyes are irritated. example air quality difference between hallway and our kitchen. hallway is much higher.
  • Check your other filters while you’re on air quality monitoring alert. We found our A/C intake duct vent had not had the air filter changed since we moved in over a year ago… and turns out it’s a non-standard size and had a hand-cut stuffed in there, so we ordered a correctly sized one for the vent, and taped a different one over the outside in the interim.
  • The other thing to fight the smoke is having n95 with valves or kn95 masks to wear when we have to go outside, or if it gets particularly bad inside. Our previous strategy was to have several on hand for wildfire season, and we’ll continue to do this. (See above in the COVID-19 section for descriptions in more detail about different kinds of masks we’ve tried.)
  • 2022 update: I got a mini personal air purifier to try for travel (to help reduce risk of COVID-19 in addition to all other precautions like staying masked on planes and indoor spaces), but it also turned out to be beneficial inside during the worst of our 2022 wildfire smoke season. I had a slightly scratchy throat even with two box fans and two different air purifiers inside; but keeping this individual one plugged in and pointed at my face overnight eliminated me waking up with a scratchy throat. That’s great for wildfire smoke, and also shows that there is some efficacy to this fan for it’s intended purpose, which is improving air around my face during travel in inside spaces for COVID-19 and other disease prevention.

Wildfires, their smoke, and COVID-19 combined is a bit of a mess for our health. Stay inside when you can, wear masks when you’re around other people outside your household that you have to share air with, wash your hands, and good luck.