- Open Access
Integrated mixed methods policy analysis for sustainable food systems: trends, challenges and future research
Public Health Reviews volume 37, Article number: 24 (2016)
Agriculture is a major contributor to greenhouse gas emissions, an important part of which is associated to deforestation and indirect land use change. Appropriate and coherent food policies can play an important role in aligning health, economic and environmental goals. From the point of view of policy analysis, however, this requires multi-sectoral, interdisciplinary approaches which can be highly complex. Important methodological advances in the area are not exempted from limitations and criticism.
We argue that there is scope for further developments in integrated quantitative and qualitative policy analysis combining existing methods, including mathematical modelling and stakeholder analysis. We outline methodological trends in the field, briefly characterise integrated mixed methods policy analysis and identify contributions, challenges and opportunities for future research. In particular, this type of approach can help address issues of uncertainty and context-specific validity, incorporate multiple perspectives and help advance meaningful interdisciplinary collaboration in the field. Substantial challenges remain, however, such as the integration of key issues related to non-communicable disease, or the incorporation of a broader range of qualitative approaches that can address important cultural and ethical dimensions of food.
Recent definitions of food sustainability have highlighted the existence of multiple inter-related dimensions including environmental, health, socioeconomic and cultural aspects . Related to this shift towards a multi-dimensional concept of food sustainability, there has been increased emphasis on the understanding of food as a complex, integrated system . This implies that environmental, health and other dimensions of sustainability need to be considered jointly, and the relevant interactions between them need to be accounted for.
In particular, certain topics such as the “food versus fuel” debate or the debate around the allocation of resources for animal feed versus plant-based food for direct human consumption have drawn attention to the importance of such interactions across sectors within the broader food system . The most prominent examples are probably livestock or global flex crops  which have several food, energy and other industrial uses, such as palm oil and corn. In these sectors, complex environmental impacts, largely related to indirect land use change, interact with changes in global dietary patterns. For example, global increases in meat consumption as part of a wider process of “nutrition transition” have been associated to increases in non-communicable disease in high-income countries. At the same time, the use of land, water and other resources for animal feed has environmental impacts and can also push up prices of cereals and other non-animal food products, aggravating malnutrition, especially in low- and middle-income countries.
Methodological trends and developments
On the one hand, the need to incorporate this complexity has led to significant methodological developments. These include the design and application of integrated conceptual frameworks , as well as complex multi-sector models [5–7]. A related trend has been the shift from traditional, attributional life-cycle analysis (LCA) towards a consequential, policy-focused LCA . Consequential LCA attempts to include all of the relevant impacts of a certain policy across different sectors within the system, taking into account potential interactions .
Concerns have been raised, however, about the limitations of these increasingly complex models. In particular, researchers have pointed out the excessive uncertainty in the results as well as the lack of comparability in terms of both results, assumptions and methodologies . In addition, important differences in language and approach can hamper interdisciplinary work in the area (ibid.). Finally, there has been increasing acknowledgement that realistic policy analysis requires an assessment not only of multiple objectives but also of the different and potentially conflictive perspectives of relevant actors . Nevertheless, these issues are still comparatively neglected and analysis often focuses on policy options that are unrealistic given the specific context for which they are recommended.
On the other hand, approaches based on stakeholder analysis have frequently been applied to the fields of natural resource management, alongside land use planning and social forestry [10, 11] and, more rarely, sustainable diets and food systems . Environmental Impact Assessments (EIA) also routinely incorporate stakeholder analysis, albeit generally from a very site-specific and geographically constrained perspective .
Stakeholder analysis is inherently context-specific although not necessarily bound by specific geographical or sectoral constraints. Moreover, the theoretical frameworks underlying these research methods, unlike most quantitative analysis in this field, tend to highlight the socially constructed nature of reality and focus explicitly on perspective and the existence of potentially conflicting objectives. Although this type of approach has its own set of limitations , it has been identified as being complementary to commonly used quantitative methods for research on sustainable food and therefore recommended for its use as part of mixed methods approaches.
What we mean by “integrated mixed-methods policy analysis for sustainable food systems” is a combination of quantitative economic and biophysical modelling and stakeholder analysis (or other qualitative methodologies) which aims to include different dimensions of sustainability across several sectors and their interactions, adopting a system perspective and a policy focus rather than addressing a specific site or technology. Similar methodological approaches have been recommended and applied in areas related to sustainable food systems over the last decade. In particular, variants of this type of approach have been recommended in fields such as sustainable nutrition at the household level , sustainable cropping , biofuels and food security  or biomass energy . These methodologies are often used together with decision-making or “decision aiding” tools such as EIA, Multi-Criteria Decision Analysis (MCDA) or Back-casting.
The main contribution of this kind of approach is probably the explicit acknowledgement of different perspectives and possibly conflicting interests alongside the analysis of intersectoral impacts and linkages, increasing transparency and diversity in policy processes. Although this methodology can also itself be captured and manipulated by specific interests, it has frequently been applied to empower fringe, marginal or vulnerable stakeholders, and methods have been developed for this purpose, such as radical transactiveness . In the case of food, these stakeholders can include smallholder farmers, workers in various segments of the industry or street food vendors, and vulnerable or low-income consumer groups, as well as more abstract entities, such as biodiversity. However, there are other relevant advantages which have been identified or suggested in the literature. Firstly, the use of methodologies that can combine quantitative and qualitative information can help to realistically manage uncertainty, dealing with different types of knowledge and uncertainty that are incorporated in food sustainability models, although often not explicitly recognised . In addition, integrated methodologies can highlight the trade-off between context-specific validity and comparability, achieving a realistic balance and focusing the analysis on context-sensitive policy options . Finally, mixed methods approaches can improve interdisciplinary collaboration, not by attempting to homogenise assumptions but rather by increasing the transparency and understanding of the differences in underlying theoretical frameworks across disciplines.
Despite the many opportunities offered by integrated mixed methods policy analysis, there remain significant challenges for its application to the field of sustainable food systems. Firstly, further work is needed in order to incorporate complex health and nutrition impacts. In particular, there is a need for further integration of emerging issues of non-communicable disease, where changing food environments and food processing mediate between health outcomes and environmental or socioeconomic impacts. Furthermore, the cultural and ethical aspects of diets are also frequently neglected in food policy analysis, despite being increasingly recognised as an integral dimension of sustainability. The adequate assessment of cultural and ethical implications of food policy might require broadening the range of qualitative methodologies within multi-sectoral policy analysis, including anthropological approaches at the household, industry and food environment levels . To conclude, we argue that there is a need for further development of integrated mixed methods policy analysis to assess food sustainability, particularly on topics such as food biofuels, flex crops or livestock, which involve both indirect land use change and complex transformations in food environments and dietary patterns.
Gustafson D, Gutman A, Leet W, Drewnowski A, Fanzo J, Ingram J. Seven food system metrics of sustainable nutrition security. Sustainability. 2016;8(3):196.
Ericksen PJ. Conceptualizing food systems for global environmental change research. Glob Environ Change. 2008;18(1):234–45.
McManus MC, Taylor CM. The changing nature of life cycle assessment. Biomass Bioenergy. 2015;82:13–26.
Borras Jr SM, Franco JC, Isakson SR, Levidow L, Vervest P. The rise of flex crops and commodities: implications for research. J Peasant Stud. 2016;43(1):93–115.
Lock K, Smith RD, Dangour AD, Keogh-Brown M, Pigatto G, Hawkes C, et al. Health, agricultural, and economic effects of adoption of healthy diet recommendations. Lancet. 2010;376(9753):1699–709.
Westhoek H, Lesschen JP, Rood T, Wagner S, De Marco A, Murphy-Bokern D, et al. Food choices, health and environment: effects of cutting Europe’s meat and dairy intake. Glob Environ Change. 2014;26:196–205.
Lampe M, Willenbockel D, Ahammad H, Blanc E, Cai Y, Calvin K, et al. Why do global long-term scenarios for agriculture differ? An overview of the AgMIP Global Economic Model Intercomparison. Agric Econ. 2014;45(1):3–20.
Bento AM, Klotz R. Climate policy decisions require policy-based lifecycle analysis. Environ Sci Technol. 2014;48(10):5379–87.
Sadok W, Angevin F, Bergez J-É, Bockstaller C, Colomb B, Guichard L, et al. Ex ante assessment of the sustainability of alternative cropping systems: implications for using multi-criteria decision-aid methods—a review. In: Sustainable Agriculture. Springer. 2009. p. 753–67.
Salam MA, Noguchi T. Evaluating capacity development for participatory forest management in Bangladesh’s Sal forests based on “4Rs” stakeholder analysis. For Policy Econ. 2006;8(8):785–96.
Arheimer B, Torstensson G, Wittgren HB. Landscape planning to reduce coastal eutrophication: agricultural practices and constructed wetlands. Landsc Urban Plan. 2004;67(1):205–15.
Lerner H, Algers B, Gunnarsson S, Nordgren A. Stakeholders on meat production, meat consumption and mitigation of climate change: Sweden as a case. J Agric Environ Ethics. 2013;26(3):663–78.
Buytaert V, Muys B, Devriendt N, Pelkmans L, Kretzschmar JG, Samson R. Towards integrated sustainability assessment for energetic use of biomass: a state of the art evaluation of assessment tools. Renew Sustain Energy Rev. 2011;15(8):3918–33.
Reed MS, Graves A, Dandy N, Posthumus H, Hubacek K, Morris J, et al. Who’s in and why? A typology of stakeholder analysis methods for natural resource management. J Environ Manage. 2009;90(5):1933–49.
Quist J, Vergragt P. Past and future of backcasting: the shift to stakeholder participation and a proposal for a methodological framework. Futures. 2006;38(9):1027–45.
Salvatore M, Damen BDB. Bioenergy and food security—the BEFS analysis for Thailand. Rome: FAO; 2010.
Mintz SW, Du Bois CM. The anthropology of food and eating. Annu Rev Anthropol. 2002;31:99–119.
I would like to thank Professor Bhavani Shankar for his helpful comments.
SC has received a doctoral scholarship from LCIRAH.
Availability of data and materials
SC is a doctoral student at London School of Hygiene and Tropical Medicine. She is affiliated to the Department of Global Health and Development as well as to LCIRAH. She is an economist by training and holds an MSc in Health Economics and Policy from Barcelona Graduate School of Economics. Her main interests are socioeconomic determinants of health, diets, health and environmental sustainability and macroeconomics and health.
The author declares that she has no competing interests.
Consent for publication
Ethics approval and consent to participate
About this article
- Food policy
- Food systems
- Land use change
- Palm oil
- Mixed methods
- Greenhouse gas emissions
- Nutrition transition