Month: February 2021

Alumni Interview series: CHOICE recent graduate Lizzy Brouwer

Posted by Sara Khor

Lizzy is one of our recent PhD graduates from the CHOICE Institute (Class of 2020). We are very excited to have Lizzy share her experience and tips with us!

“I found that a methodical, small-steps approach helped me not feel overwhelmed by whole process.”

Lizzy Brouwer

Why did you choose to do a PhD?  And how did you choose health economics?

I fell into health economics as a way to merge my two loves as an undergraduate student: social policy and mathematics. I was interested in researching and promoting policies that increased equitable access to affordable health care, which lead me to a Master of Public Health in health policy at the University of Michigan in Ann Arbor. We were required to take several economics courses as part of the curriculum, and I loved applying economic principles to real-world data in order to answer health policy questions. After a few years in research, I realized I wanted to dive deeper into the methods I was using and eventually take a bigger leadership role in projects. That led to a PhD program.

What was the topic of your PhD?

My dissertation was titled, “Exploring the uptake of value-based formulary strategies and their application to specialty drugs.” My first aim explored whether patient out-of-pocket costs were associated with value as defined by cost-effectiveness analysis to understand the integration of value information in private formularies. My second aim looked at the use of patient assistance programs (also commonly referred to as copay coupons) for specialty drugs and how their presence affected patient demand. The purpose of this aim was to understand if patients were responsive to changes in out-of-pocket costs for specialty drugs in the face of manufacturer-provided financial assistance, and therefore whether value-based insurance design could be an effective lever in that context.

What are you currently working on?  Does this align with your training or your research interests?

I am currently working in two jobs. The first is as a research scientist at CHOICE building models in collaboration with the Institute for Clinical and Economic Review (ICER). This exciting opportunity allows me to be involved in national conversations about drug value with one of the leading health economics organizations in the United States, with the added bonus of continuing to work with the wonderful CHOICE faculty. My other role is a research associate with Curta Consulting, which was founded by CHOICE alumna, Lisa Bloudek. In this position, I work on research projects and model building for various biopharmaceutical companies. I really enjoy the fast pace and the wide variety of topics covered, as well as better understanding the role and nuances of health economics in the private sector.

Can you share one of your favorite or proudest moments during the PhD years?

I had my first child during my 3rd year, and it was harder than I anticipated to manage my family responsibilities while also moving my dissertation forward. When I returned from maternity leave at the beginning of fall quarter, I was determined to regain any lost momentum and I created an ambitious timeline for myself. Therefore, my proudest moment of the program was in the spring of that academic year when I had my long dissertation proposal approved, my general exam scheduled, and was awarded both the Lou Garrison Award for work in Health Economics and the PhARMA Foundation Predoctoral Fellowship in Health Outcomes. It felt like validation for my commitment to momentum during the previous months.

I also scheduled regular meetings with my chair and printed out an itemized agenda for each meeting to ensure our time was used efficiently… By writing everything down and methodically checking it off, I was able to feel reasonably sure I was not dropping any of the details I was juggling.

What do you think are the “secret sauces” of a successful PhD experience?

Every student is different and will have different paths to success, however I found that a methodical, small-steps approach helped me not feel overwhelmed by whole process. This meant outlining major milestones and then breaking down all the steps needed to get there. Once the larger tasks were broken down, they felt much more manageable. For example, I created deadlines for myself to produce and submit drafts of my dissertation products (short proposal, long proposal, analysis plans, manuscripts, dissertation chapters, etc), and I stayed (mostly) accountable to those deadlines. I also scheduled regular meetings with my chair and printed out an itemized agenda for each meeting to ensure our time was used efficiently. For example, if there was a roadblock in my research, I tried to outline the problem and suggest 2-3 paths forward for us to discuss. By writing everything down and methodically checking it off, I was able to feel reasonably sure I was not dropping any of the details I was juggling.

Advice for current/ future PhD students?

You can do it! Take breaks, have fun, and finish the darn thing 😊

Alumni Interview series: CHOICE recent graduate Nathaniel Hendrix

posted by Sara Khor

We are starting a series of interviews with graduates from the CHOICE Institute, and are very excited to have Nathaniel Hendrix, who graduated from the PhD program in 2020, share his experience with us.

  • Nathaniel in the grad room, before the pandemic

“Grad school is like training a pet, where the pet is your own mind… You have to be intentional about figuring out what you want to teach yourself and how you’re going to do it.”

Nathaniel Hendrix
  1. Why did you choose to do a PhD?  How did you choose health economics?

I entered the PhD program directly after graduating with my PharmD. I went into my clinical training imagining that almost all of our decisions were grounded in a solid basis of evidence. But once I learned to read studies for myself, I began to see how complex the processes of gathering and evaluating evidence really were. This made me a bit hung up on how clinicians make decisions and how they can learn to make them better.

I had always been pretty indulgent with myself about taking electives during my PharmD training. I’d explored computer science and philosophy of science, but when I started taking classes in health economics, that gave me a vocabulary for talking and thinking about decision-making that I hadn’t been able to find before. At the same time, it’s a relatively young field and a very interdisciplinary one, so it felt to me like I could impact the direction of the field and that my curiosity about exploring different ideas would be rewarded.

2. What was the topic of your PhD?

My dissertation was on using health economics tools to solve translational issues in artificial intelligence (AI). It had two separate aims. First, I conducted a discrete choice experiment to see what primary care providers see as valuable in how AI could be used for breast cancer screening. Most women who take part in breast cancer screening make the decision to start with their primary care providers, so these providers have an outsized role to play in determining how AI will be used for breast cancer screening. We found that there were multiple ways that developers can appeal to primary care providers with their AI products: by improving sensitivity, by having a well-thought-out workflow that includes radiologists, and by having highly diverse training data.

The second aim had to do with using cost-effectiveness analysis to inform how AI algorithms are used for breast cancer screening. We used a real set of AI algorithms that had been submitted to a contest and used different methods of selecting a sensitivity/specificity threshold at which they could operate. Our model ended up selecting very similar thresholds as other heuristic methods, but it taught me a lot about the challenges of using cost-effectiveness analysis on AI.

“Write down every research idea that you have, and revisit that list frequently. Half of the ideas will be terrible in retrospect, but that’s okay.”

3. What are you currently working on?  Does this align with your training or your research interests?

After my PhD, I started a postdoc at the Harvard T.H. Chan School of Public Health, where I’m mostly studying cost-effectiveness methodology. I have three main projects right now. First, I’m working on developing methods for integrating financial risk protection into decisions about prioritizing healthcare interventions in low- and middle-income countries. Healthcare plays a major role in keeping people out of poverty, but this isn’t acknowledged in conventional cost-effectiveness analysis.

Next, I’m working on methods for assessing the cost-effectiveness of health system strengthening interventions, such as building new facilities, training personnel, or developing a new informatics infrastructure. This is challenging because these long-term projects, which almost everyone acknowledges as important, have to compete for funding against urgent needs like making more medicines available or expanding vaccinations.

Finally, I’m completing a project about how to use Deep Learning-based breast cancer risk scores to personalize screening. Even though breast cancer screening reduces cancer mortality, there are many downsides because the false-positive rate is pretty high in screening. So we’re hoping we can use AI to determine who is most likely to benefit from screening and who might have a higher risk of being harmed.

I see this last project as most connected to my PhD research, because I’m using many of the same techniques that I used in the second aim of my dissertation. But I’m also learning many methods like constrained optimization that aren’t emphasized at UW but that are important when thinking about operating a healthcare system efficiently. Of course, I’m also wrapping up several projects I started during my time at UW, so there’s some continuity there too.

4.  What are some of the things you wish you’d known when you started your PhD?

I wish I had had a better system for keeping track of the things I was reading. Ultimately, I missed the opportunity for making connections because it took me until I was well into my dissertation to discover the tools I needed for taking notes and helping myself to rediscover ideas I’d read in the past. For me, this ended up being the Zettelkasten system, which I use on the website Roam Research (read Sönke Ahrens’s book, “How to take smart notes,” for more info on this!).

5. Can you share one of your favorite or proudest moments during the PhD years?

Probably my proudest moment was when I found out that I had gotten a PhRMA Foundation fellowship for my dissertation. I was on vacation in San Francisco, waiting out an afternoon rainstorm in a café when I got the call, and it was really a pivotal moment for me. I had been feeling a bit of imposter syndrome about my dissertation, but to know that these other researchers had found my ideas exciting enough to fund was a huge boost of confidence.

“I’m convinced that you can’t be a good researcher without learning to be a good reader.”

6. What do you think are the “secret sauces” of a successful PhD experience?

Completing a PhD program is a great chance to explore. I didn’t quite understand this when I went into it and felt pressured (by myself, really!) to focus more on one area or another. Once I started just saying yes to every experience I had time for, I started to learn a lot more. This meant not just learning more about different technical matters, but also learning about what sort of work styles and communication styles I’m most comfortable with. That’s super important, because our work is usually so collaborative.

As you go through a PhD program and learn more, what’s expected from you also changes. In the beginning, you’re soaking up new methods and concepts, so you end up doing a lot of work on tasks like data cleaning or literature review that are really time consuming but necessary. With more experience, you should be able to start making suggestions to your collaborators about the directions for your work. And then finally, with your dissertation, you get a lot more independence about its direction.

Part of this development process is having good reading habits. That means keeping track of what journals are publishing so that you have a sense of what current conversations are happening. And then, again, finding ways to make connections between what you read. Ultimately, I’m convinced that you can’t be a good researcher without learning to be a good reader.

7. What do you think is the best metaphor for your grad school experience?  How would you complete this sentence: “Grad school is like…”

Grad school is like training a pet, where the pet is your own mind. During grad school, you’ll have to teach yourself a lot of new skills, so it’s important to think about how to keep yourself motivated. It’s also vital to learn to recognize when you’re tired and need to do something entertaining. But overall, you have to be intentional about figuring out what you want to teach yourself and how you’re going to do it.

8.    Do you have any other advice for current/future PhD students?

Write down every research idea that you have, and revisit that list frequently. Half of the ideas will be terrible in retrospect, but that’s okay. It’s easier to come up with good ideas if you come up with lots of ideas. And, again, to come up with ideas, it’s important to cultivate a very intentional habit of reading academic literature.

Also, I would encourage students to publish broadly. Look at the areas where they’re doing projects, compare it to the major areas in the CHOICE curriculum, and see if there are any weaknesses. You’ll have a lot more flexibility with your job search if you publish broadly. One way to do this is to collaborate with a lot of different people who are working in different areas.