Training in progress, step 20

adapter_config.json

@@ -1,7 +1,7 @@
 {
   "alpha_pattern": {},
   "auto_mapping": null,
-  "base_model_name_or_path": "mistralai/Mistral-7B-Instruct-v0.1",
+  "base_model_name_or_path": "meta-llama/Llama-2-7b-chat-hf",
   "bias": "none",
   "fan_in_fan_out": false,
   "inference_mode": true,
@@ -19,13 +19,13 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "v_proj",
-    "q_proj",
-    "k_proj",
+    "o_proj",
     "gate_proj",
+    "k_proj",
     "up_proj",
-    "o_proj",
-    "down_proj"
+    "down_proj",
+    "q_proj",
+    "v_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_rslora": false

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f2430ae547f247197d07edcd4e29609e906d7bc66b88919b48a23d6ad090d2b4
-size 335604696
+oid sha256:b9d3b982046e48e0049a3f73c11dbe5b8a36859f750a1696ef0ca7095c738f61
+size 319876032

qual_clasification.log

@@ -54,3 +54,10 @@
 2024-02-13 16:31:59,095 - INFO - __main__ - Loaded Model ID: mistralai/Mistral-7B-Instruct-v0.1
 2024-02-13 16:32:00,182 - INFO - __main__ - Loaded LoRA Model
 2024-02-13 16:32:00,833 - INFO - __main__ - Instantiated Trainer
+2024-02-13 17:45:18,147 - INFO - __main__ - Completed fine-tuning
+2024-02-13 17:45:20,413 - INFO - __main__ - Saved model and tokenizer to machine_learning/llm_finetune_models/0
+2024-02-13 17:45:22,835 - INFO - __main__ - Saved model to hub
+2024-02-13 17:47:37,744 - INFO - __main__ - Completed EM Metrics evaluation
+2024-02-13 17:49:02,594 - INFO - __main__ - Loaded Model ID: meta-llama/Llama-2-7b-chat-hf
+2024-02-13 17:49:03,757 - INFO - __main__ - Loaded LoRA Model
+2024-02-13 17:49:04,365 - INFO - __main__ - Instantiated Trainer

qual_clasification_outputs.csv

@@ -7,14 +7,18 @@ DESCRIPTION (provided by applicant): This project will investigate the feasibili
 
 
 Qualitative Keywords:
-focus groups; ethnographic",QUALITATIVE,QUALITATIVE,QUALITATIVE,QUALITATIVE,QUALITATIVE</s>,CORRECT
+focus groups; ethnographic",QUALITATIVE,QUALITATIVE,QUALITATIVE,QUALITATIVE,"QUALITATIVE]
+
+Output either",RESOLVABLE
 1,"Grant Abstract:
 Because chemistry explores phenomena that can be observed with the senses, but are explained based on the molecular-level behavior of invisible molecules, atoms, and ions, effective use of visual representations of molecular-level phenomena is essential for communicating about chemistry. Research also shows that there is a positive relationship between the ability to see chemical concepts among different representations and successful chemistry problem solving. Chemistry instructors may sometimes assume that, as their instruction addresses conceptual understanding, students' visualization skills will naturally develop. Consequently, instructors may not explicitly teach visualization skills and processes in their courses. This Improving Undergraduate STEM Education project will develop and test a set of ten modules to explicitly teach visualization skills and the use of visual representations to students in college chemistry courses. The modules will support students in understanding progressively more complex content and visual representations across the chemistry curriculum.
 
 Each of the ten modules will be developed, pilot tested, revised, and ultimately implemented in an upper-division chemistry course. In developing the modules, three main mechanisms will be employed to support students development of visualization skills: drawing attention to prominent features and patterns to reduce attention to extraneous information and cognitive load, decomposing a complex problem into more manageable parts, and problematizing to encourage students to make their ideas and thinking processes explicit. During the pilot-testing phase, the main data sources will include the copies of students' work on the activities and recorded sessions from focus groups. Analyses of these data will employ a drawing to learn framework to assess visualization objectives and an argumentation framework to assess problematization. In addition, the selection of representations included in the module activities will be evaluated for areas of visual attention using eye-tracking methodologies in conjunction with a retrospective think-aloud method. Once the modules have been pilot tested and revised, they will be implemented as a set during a one-semester intervention, scaffolding both chemistry content and visual complexity in representations. A rubric will be developed to track students' progress in the use of deconstruction as a problem solving strategy and sophistication in verbalization of visual mental constructs. Quantitative data from pre- and post-test scores on two standardized visualization tools will complement documentation of visualization gains, and the impact of the intervention on student achievement will be determined. Ultimately, the project will provide faculty with robust instructional materials that they can use in their classrooms to promote visualization and effective problem solving in chemistry.
 
 Qualitative Keywords:
-focus groups",QUANTITATIVE,MIXED,NON_QUALITATIVE,QUALITATIVE,QUANTITATIVE</s>,CORRECT
+focus groups",QUANTITATIVE,MIXED,NON_QUALITATIVE,QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 2,"Grant Abstract:
 Computer Science (31) 
 
@@ -25,7 +29,9 @@ The project proposes novel pedagogies for undergraduate Cryptography and the han
 The project facilitates faculty collaboration and development at three institutions in three states Tennessee, Georgia and Alabama. It broadens participations of minority students in Information Assurance due to the leadership of Tuskegee University, an experienced institution in minority education. Dissemination of the generated teaching materials is supported by summer mini-workshops, a dedicated website developed and maintained by the PIs, conference presentations, and journal publications.
 
 Qualitative Keywords:
-case studies",QUANTITATIVE,QUANTITATIVE,NON_QUALITATIVE,NON_QUALITATIVE,QUANTITATIVE</s>,CORRECT
+case studies",QUANTITATIVE,QUANTITATIVE,NON_QUALITATIVE,NON_QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 3,"Grant Abstract:
   
 
@@ -48,7 +54,9 @@ to enroll 198 subjects and randomize them to one of three treatment groups that
 
 
 Qualitative Keywords:
-diary",QUANTITATIVE,QUANTITATIVE,NON_QUALITATIVE,NON_QUALITATIVE,QUANTITATIVE</s>,CORRECT
+diary",QUANTITATIVE,QUANTITATIVE,NON_QUALITATIVE,NON_QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 4,"Grant Abstract:
   
 
@@ -65,7 +73,10 @@ DESCRIPTION (provided by applicant): One of the projected health dividends of th
 
 
 Qualitative Keywords:
-qualitative methods",QUALITATIVE,MIXED,QUALITATIVE,QUALITATIVE,QUALITATIVE</s>,CORRECT
+qualitative methods",QUALITATIVE,MIXED,QUALITATIVE,QUALITATIVE,"QUALITATIVE
+
+
+Output either",RESOLVABLE
 5,"Grant Abstract:
 A research team consisting of Dr. Peter Cole, Dr. Gabriella Hermon, 
 and Dr. Uri Tadmor, assisted by Ms. Yanti Jotika, a graduate student 
@@ -94,7 +105,9 @@ marginalized community. Equally important is the role of the project
 in training international graduate students.
 
 Qualitative Keywords:
-fieldwork",QUANTITATIVE,QUALITATIVE,NON_QUALITATIVE,QUALITATIVE,QUANTITATIVE</s>,CORRECT
+fieldwork",QUANTITATIVE,QUALITATIVE,NON_QUALITATIVE,QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 6,"Grant Abstract:
 Project Abstract
 SES Proposal 0135333
@@ -139,16 +152,18 @@ to readdress the relationship between expertise and democracy and explore the fu
 science and technology as forms of political thought and practice.
 
 Qualitative Keywords:
-case studies",QUANTITATIVE,QUALITATIVE,NON_QUALITATIVE,QUALITATIVE,QUANTITATIVE</s>,CORRECT
+case studies",QUANTITATIVE,QUALITATIVE,NON_QUALITATIVE,QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 7,"Grant Abstract:
 Using ethnographic and archival methods, this study will develop a comparative case analysis of two successful long-term cyberinfrastructures that have been supporting scientific research for nearly thirty years, in ecology and medical science: the Long-term Ecological Research Network (LTER) and the Multi-Center AIDS Cohort Study (MACS). Archival research will provide a backdrop to current events that will be investigated ethnographically.  The project addresses a significant gap in comparative studies of infrastructure, refocusing attention on the implications of the always-changing technologies, sociotechnical-organization, and institutional environments that make up contemporary research infrastructures.  The central research questions is: How are ""old organizations"" renewing themselves to sustain value for ""new science""? By investigating the past and present of cyberinfrastructures that have weathered many transformations, this research seeks to inform future cyberinfrastructure development efforts.  The findings will identify successful ""strategies of the long-term"" -- organizational forms and methods of design with a track-record of facilitating responsiveness to change.  These insights will be a contribution to the fields of Science and Technology Studies (STS), science policy, organization science, and the sociotechnical design of research infrastructure.
 
 The purpose of this research is to understand the challenges that long-term scientific organizations face over time, and the strategies they employ to manage these challenges. The development of scientific research infrastructure is central to the NSF?s vision of science; however there has as yet been little or sporadic empirical attention to the dynamics of flexible long-term infrastructure in the face of changing social organization, information technology (IT) and scientific interests. This research will fill that gap, contributing to new, practical, and boundary-spanning knowledge about the characteristics of infrastructure in the making and over the long-term.  This project will inform efforts to build more open, effective, and sustainable cyberinfrastructure in the sciences, leading to smarter and more sustainable investment and design choices on the part of cyberinfrastructure project leaders, participants, tool builders, and funders.  This research will also inform science policy and regulatory environments, to help foster a sustainable and productive research infrastructure across multiple fields of inquiry.
 
 Qualitative Keywords:
-archival research; ethnographic",QUALITATIVE,QUALITATIVE,QUALITATIVE,QUALITATIVE,"QUALITATIVE
+archival research; ethnographic",QUALITATIVE,QUALITATIVE,QUALITATIVE,QUALITATIVE,"QUALITATIVE]
 
-This grant refers",RESOLVABLE
+Output either",RESOLVABLE
 8,"Grant Abstract:
   
 DESCRIPTION (provided by applicant): Tooth decay in 2 to 11 year olds is increasing nationally especially among poor and minority populations, and it is unlikely that Healthy People 2020 goals will be met. Dental screening of children in public elementary schools has been mandated in 12 states and endorsed by U.S. and international organizations. Nevertheless, in spite of enthusiasm for the concept, screening and referral has been ineffective as a tool to get parents and caregivers to take children to the dentist. This application is to support planning of a Phase II randomized clinical trial to assess the effectiveness of a referral approach to increase dental attendance (for receipt of care) among inner-city urban elementary school children with urgent/restorative needs. The intervention to be tested relies on two theoretical frameworks -Common Sense Model of Self-Regulation (CSM), and the theory of Planned Behavior (TPB) that could be used in conjunction with child-level interventions in a school-based program. The objectives of the R34 study will occur in two phases: (1) pilot phase to validate the modified illness perception questionnaire -Revised (IPQ-RD) for dental caries, acceptability and delivery of the intervention, mediators and moderators for accessing care; focus groups of community organizations and providers to identify enabling resources to be included in the experimental intervention; and testing the experimental intervention regarding appropriateness/accuracy of educational materials; (2) planning phase primarily devoted to the major planning activities required for a U01 submission including development of the study protocol, manual of operations, and Institutional Review Board application and its associated materials. The sample size for the R34 includes 120 caregivers of KG, first, and second grade school children recruited from among 5 elementary schools in an urban inner-city school district in Cleveland, OH, and 10 to 20 key informants from several community agencies or providers. Data collection involves semi-structured one-to-one interviews and questionnaire responses for caregivers and focus groups for community/provider informants. Data analysis will utilize a mixed method design (grounded theory and theory driven) for qualitative data, and descriptive/analytical statistics for quantitative data. This behavioral approach has the potential to change the public health standard of practice for screening programs by utilizing a cost-effective, easily transportable, and sustainable referral approach. The transdiscipilinary research team includes faculty from Department of Community Dentistry at Case Western Reserve and the Northwest Center to Reduce Oral Health Disparities at the University of Washington.  
@@ -156,7 +171,9 @@ DESCRIPTION (provided by applicant): Tooth decay in 2 to 11 year olds is increas
 
 
 Qualitative Keywords:
-focus groups",MIXED,MIXED,QUALITATIVE,QUALITATIVE,MIXED</s>,CORRECT
+focus groups",QUANTITATIVE,MIXED,NON_QUALITATIVE,QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 9,"Grant Abstract:
 Northern wild rice (manoomin) grows in the lakes and rivers of the North American Great Lakes region and is a culturally important food for indigenous and non-native people, while also serving as an indicator of ecosystem health. A decline in ecosystem health has been observed across the region, a result of a mix of environmental stressors, cultural values, public policies, and human practices. This project seeks to understand the social and environmental causes of manoomin decline using an interdisciplinary approach and by co-producing knowledge. The investigators plan to use an integration of science and indigenous knowledge to overcome obstacles to understanding the complex interactions. The study will specifically target the influence of interactions among the environment and diverse cultural values, policies, and practices. The project is a partnership between tribes and university scientists and includes an indigenous worldview in social ecosystems by incorporating indigenous knowledge in the research. Ultimately this project will produce scientific understanding needed to restore these culturally and economically important ecosystems while incorporating native voices in ecosystem management. Understanding manoomin as a social-environmental system will generate broader impacts that include restoration of this important resource in the Great Lakes region and a framework for collaborative research and management applicable to Indigenous resource issues globally. 
 
@@ -165,9 +182,9 @@ This interdisciplinary collaborative research project has three interdependent c
 This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
 
 Qualitative Keywords:
-in-depth interviews; focus groups; fieldwork",QUALITATIVE,MIXED,QUALITATIVE,QUALITATIVE,"QUALITATIVE
+in-depth interviews; focus groups; fieldwork",QUANTITATIVE,MIXED,NON_QUALITATIVE,QUALITATIVE,"QUANTITATIVE]
 
-What sort of",RESOLVABLE
+Output either",RESOLVABLE
 10,"Grant Abstract:
 This is a collaborative proposal among the University of Illinois at Chicago, Michigan State University, and SRI International to develop, test, and analyze sets of technology-supported diagnostic classroom assessments for middle school (grades 6-8) physical science. Assessments are aligned with the performance assessment and evidence-centered design methodologies suggested in the Framework for K-12 Science Education (NRC, 2012). The study focuses on the development of new measures of learning that take into account the interdependence of science content and practice. Two disciplinary core ideas--Matter and its Interactions, and Energy--and two scientific and engineering practices--Constructing Explanations and Designing Solutions, and Developing and Using Models--are used for this purpose. 
 
@@ -178,23 +195,27 @@ Assessments are iteratively designed and administered in three school districts
 Project outcomes are: (a) research-informed and field-tested assessment prototypes that measure students' thinking around the two physical science core ideas and the two scientific and engineering practices; (b) relevant data and procedures used in the studies; and (c) a framework for the formative use of the assessments, including guidelines, scoring rubrics, and criteria for assessment design decisions.
 
 Qualitative Keywords:
-focus groups",QUANTITATIVE,MIXED,NON_QUALITATIVE,QUALITATIVE,QUANTITATIVE</s>,CORRECT
+focus groups",QUANTITATIVE,MIXED,NON_QUALITATIVE,QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 11,"Grant Abstract:
 Today, most scientific research is done by scientists working together in teams, and many current social problems are so complicated that they require large, interdisciplinary teams of scientists. But, it is not always obvious who the best scientists are to include in a team and whether teams with certain types of scientists have different behaviors or practices than teams with other types of scientists. This project is studying whether teams with different team composition have different behaviors and practices. Some research shows that team composition (such as the gender, ethnicity, or discipline of the team members; also called team diversity) influences science outcomes such as effectiveness and productivity. But, there is little research that examines how team diversity affects scientists' ethical behavior, which is the focus of this study. The ethical behavior of scientists matters because it can determine the quality of the science that gets done, and it can influence the trust that society places in scientists.  To answer this question, the awardee will measure team diversity and determine how it affects ethical behaviors related to materials sharing, authorship, and mentoring. It is expected that scientists who work in more diverse teams (e.g., those that include women, members of racial or ethnic minority groups, or individuals from different disciplinary backgrounds) may promote team cultures that include social sensitivity and ideals of community welfare. Therefore, higher team diversity may advance science's effectiveness by promoting more ethical standards and practices.  
 
 This project will conduct both qualitative and quantitative surveys of individuals who are part of teams in three NSF programs that fund highly collaborative research: Dimensions of Biodiversity, Dynamics of Coupled Natural and Human Systems, and Macrosystems Biology. The project will first perform qualitative interviews on a subset of individuals working in teams funded by these three NSF programs to develop more precise hypotheses about the relationships between team diversity and ethical behaviors.  Then, those hypotheses will be tested using a quantitative survey administered to the remainder of the funded teams. The quantitative survey responses will be analyzed using multilevel mediation modeling that accounts for the nested nature of the data (i.e., individuals nested within teams) and that can determine relationships between team diversity and ethical behaviors as well as the factors mediating those relationships. In addition to sharing study results, the project team will develop and facilitate workshops to help interdisciplinary environmental scientists recognize the effects of diversity on ethical standards and practices and facilitate increased diversity within teams.
 
 Qualitative Keywords:
-qualitative interviews",QUALITATIVE,MIXED,QUALITATIVE,QUALITATIVE,"QUALITATIVE
+qualitative interviews",QUANTITATIVE,MIXED,NON_QUALITATIVE,QUALITATIVE,"QUANTITATIVE]
 
-What type of",RESOLVABLE
+Output either",RESOLVABLE
 12,"Grant Abstract:
 This Exploration and Design project in the Engaged Student Learning track in the Improving Undergraduate Science Education program seeks to address the intractable concept of transfer of learning to new settings. A central assumption in most systems of education is that students will be able to apply knowledge and skills beyond the context in which they are originally learned and hence transfer their learning. Existing research studies indicate, however, that successful transfer is exceedingly rare. In this project, transfer will be examined within an existing series of undergraduate science courses intended to promote coherent understanding of energy in physics, chemistry, Earth science, and biology. Energy, a unifying concept important in most science disciplines, is central to scientific literacy and is an idea students should be able to apply to a variety of situations. The integrated curriculum presents energy coherently across disciplines, was designed on the basis of cognitive research, and has been extensively classroom tested at multiple institutions. The course sequence thus serves as a natural laboratory to investigate how much transfer is possible under highly favorable, yet still realizable, conditions. Unifying Science for Students will measure and describe transfer, as well as document the specific components of instruction that promote transfer. Special attention will be paid to understanding how to support transfer among students from traditionally underrepresented groups. Findings will contribute to the knowledge base of what works in supporting application of energy concepts across contexts, for all students.  This project may also help to establish the integrated course sequence as a national model for coherent, cross-disciplinary undergraduate science education. 
 
 The integrated curriculum spans four courses: The Flow of Matter and Energy in Physical Systems, Earth Systems, Life Systems, and Chemical Systems. Unifying Science for Students will bring together expertise in physics, chemistry, biology, geology, and cognitive science at two institutions to add to the research base on transfer, using this course series. It will do so by: (1) evaluating the extent to which students successfully transfer understanding of energy in a coherent, constructivist-based sequence of science courses; (2) documenting the productive and problematic reasoning approaches that arise when students transfer ideas about energy to new contexts; (3) identifying instructional cues that facilitate transfer; and (4) investigating the impact of explicit instruction in metacognition on the understanding, retention, and transfer of energy concepts across disciplines.  Quantitative and qualitative methods will be employed to address these goals. A longitudinal study will generate quantitative measures of the transfer of energy concepts from the original learning context, physics, to a target domain, chemistry. Interviews, classroom observations, and analysis of written work will be used to describe what transfer ""looks like"" by developing a taxonomy of discipline-specific transfer attempts. Finally, a quasi-experimental study will investigate the impact of metacognitive writing assignments on transfer. The general and discipline-specific knowledge generated through this project will be situated to inform curriculum design so that transfer can become a more realizable goal in higher education. The Robert Noyce Teacher Scholarship program is providing co-funding for this project in recognition of its alignment with the broader teacher preparation goals of the Noyce effort.
 
 Qualitative Keywords:
-qualitative methods",QUANTITATIVE,MIXED,NON_QUALITATIVE,QUALITATIVE,QUANTITATIVE</s>,CORRECT
+qualitative methods",QUANTITATIVE,MIXED,NON_QUALITATIVE,QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 13,"Grant Abstract:
 Southern Polytechnic State University (SPSU), and Tennessee State University (TSU) are jointly developing a new information assurance and security (IAS) teaching methodology. Curricular materials based on a portable lab are being developed and integrated into Computer Science (CS) and Information Technology (IT) courses.  This work is renovating the content of the IAS curriculum by emphasizing mobile security through hands-on experience using a portable Lab. The result is a full set of materials covering the core knowledge area on IAS, and a portable lab that can be used in online courses on IAS, providing hands-on experience with real-world situations.  This work is having a significant impact on the national IAS workforce and is targeting students from underrepresented groups.
 
@@ -203,22 +224,30 @@ The labware is designed according to the IAS curriculum recommendations in the I
 The project is being evaluated to determine the impact of the learning modules on student learning outcomes and teaching effectiveness. Both internal (self) and external evaluations are being used.  Internal evaluations are conducted by each of the PIs for the project and external evaluations are conducted by individuals from academia and industry.  Evaluation data is assessed by a team of external evaluators consisting of an evaluator from academia and an evaluator from industry.
 
 Qualitative Keywords:
-case study",QUANTITATIVE,QUANTITATIVE,NON_QUALITATIVE,NON_QUALITATIVE,QUANTITATIVE</s>,CORRECT
+case study",QUANTITATIVE,QUANTITATIVE,NON_QUALITATIVE,NON_QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 14,"Grant Abstract:
 This dissertation research investigates the interrelationships among tourists, tour guides, and the historical sites in Jerusalem.  The principal focus is on the role of tour guides who mediate the tourist experience for a variety of groups who come to the site with different expectations.  The guides also have to manage the logistic difficulties in a city with repeated conflict.  In-depth interviews and participant observation are used to build a description of how the tour guides manage the often competing relationships with the government, the citizens, and the tourist groups.  The results are expected to modify conventional views of tourism that tourists simply consume the products offered by the tourist sites; rather the tourist experience is a product of complex mediation by tour guides and their social relations with several different actors.
 
 Qualitative Keywords:
-in-depth interviews; participant observation",QUALITATIVE,QUALITATIVE,QUALITATIVE,QUALITATIVE,QUALITATIVE</s>,CORRECT
+in-depth interviews; participant observation",QUALITATIVE,QUALITATIVE,QUALITATIVE,QUALITATIVE,"QUALITATIVE]
+
+Output either",RESOLVABLE
 15,"Grant Abstract:
 Epilepsy is the most frequent neurological disorder in children in developing countries. Research in Kilifi district, one of the poorest areas in Kenya, has revealed some of the highest prevalence rates in Kenya and on the African continent.  Biomedical anti-epilepsy drugs are effective at controlling seizures. However, fewer than 5% of children with active epilepsy in Kilifi District access and adhere to these medications. This context presents several theoretical questions including: why do so few families access bio-medical treatment? and, how do epilepsy and treatment choice affect the lives and well-being of the families of these children? Thomas Weisner and Nathaniel Kendall-Taylor's research project examines how cultural and material factors influence the way families seek treatment for pediatric epilepsy, and how these factors and their treatment choices affect the concept of family well-being. Their primary objectives are to: 1) improve the theoretical understanding of how epilepsy, and chronic pediatric disabilities more generally affect the well-being of a family, 2) examine the cultural, social, and material factors that shape how these families seek treatment, and 3) explore how different treatment decisions influence family dynamics and functioning. Their research applies a mixed methods approach including surveys, person-centered interviews, participant observation and structured monitoring.  Their project contributes to the literature on the effects of family factors on the management of childhood disability, and adds to the recently developed anthropological literature on ""well-being"".  Additionally their project will provide training in ethnographic methods for Nathaniel, a PhD student, and will develop his regional specialization in Coastal East Africa.
 
 Qualitative Keywords:
-participant observation; ethnographic",MIXED,MIXED,QUALITATIVE,QUALITATIVE,MIXED</s>,CORRECT
+participant observation; ethnographic",QUALITATIVE,MIXED,QUALITATIVE,QUALITATIVE,"QUALITATIVE
+
+]/INST",RESOLVABLE
 16,"Grant Abstract:
 Urban infrastructure refers to engineered systems that provide water, energy, transport, sanitation and information services to more than half of the world's population living in cities today. With rapidly increasing human populations, projected resource scarcities and vulnerability to natural and man-made disasters, cities require new, high-performing, cost-effective, and environment-friendly infrastructures for future urban sustainability. The over-arching question addressed in this Integrative Graduate Education and Research Traineeship (IGERT) project is:  What are the inter-connections between infrastructure engineering, urban planning, public policy, health and human behavior that must be explored today to design effective and sustainable urban infrastructure systems of the future?  This question will be answered through a unique, multi-disciplinary graduate curriculum on sustainable urban infrastructure linking engineering, architecture and planning, public affairs, and health and behavioral sciences.  IGERT research will integrate emerging technologies, urban development patterns, economic instruments, policy strategies, and human behavioral factors for design of future urban water supply, energy supply, transportation, waste management and public health infrastructures.  Active fieldwork will occur in collaboration with the City of Denver, Colorado and Chennai, India.  The project has the potential to directly impact more than 200 graduate students at UCDHSC, the 580,000 residents of Denver and the 4 million people of Chennai. The dissemination potential is high for cities world-wide, where about 3 billion people currently live. IGERT is an NSF-wide program intended to meet the challenges of educating U.S. Ph.D. scientists and engineers with the interdisciplinary background, deep knowledge in a chosen discipline, and the technical, professional, and personal skills needed for the career demands of the future. The program is intended to catalyze a cultural change in graduate education by establishing innovative new models for graduate education and training in a fertile environment for collaborative research that transcends traditional disciplinary boundaries.
 
 Qualitative Keywords:
-fieldwork",QUANTITATIVE,MIXED,NON_QUALITATIVE,QUALITATIVE,QUANTITATIVE</s>,CORRECT
+fieldwork",QUANTITATIVE,MIXED,NON_QUALITATIVE,QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 17,"Grant Abstract:
 General Summary
 
@@ -230,16 +259,18 @@ Technical Summary
 Specifically, this project addresses how local and national women's organizations in post-conflict areas of West Africa work to advocate for women's security. To do so, this study uses participant observation and interviews in Guinea and Mali (building on prior research in Cote d'Ivoire) to reveal how international resolutions impact local actions and also whether and how local women's priorities can shape international policies. Analyzing policies on women's security and the discourses that sustain them through macro-, meso-, and micro-level lenses will reveal how local and regional women's community organizations define their security goals and priorities, translate and localize the international agendas of the UN Security Council and transnational NGOs as well as the national agendas of governments, and work with local women to achieve peace and security. By examining the conflicts in Guinea and Mali, this project will develop a framework of how to understand women's needs in their communities and in national peacebuilding and reconstruction projects, underscoring that historical, political, and cultural contexts are important in developing successful, appropriate security policies.
 
 Qualitative Keywords:
-",QUALITATIVE,QUALITATIVE,QUALITATIVE,QUALITATIVE,"QUALITATIVE
+",QUALITATIVE,QUALITATIVE,QUALITATIVE,QUALITATIVE,"QUALITATIVE]
 
-What specific qual",RESOLVABLE
+Output either",RESOLVABLE
 18,"Grant Abstract:
 The late Paleozoic Ice Age is the longest-lived glacial interval of the past half billion years, sharing many parallels with the current icehouse in which humans evolved and live. During the Paleozoic icehouse (340 to 290 million years ago) atmospheric oxygen and carbon levels were anomalous, life moved onto land, the first wooded forests expanded across the Earth, and large-scale wildfires emerged.  Thus, it is important that we develop a more complete understanding of the late Paleozoic Earth and its dynamic glaciation history. The glacial-marine Parana Basin, Brazil provides an ideal opportunity for this work and the project will include training for U.S. and Brazilian students through seminars, field and lab work, and exchange visits.
 
 This research will address three research objectives. First, an exportable, accurate and high-precision chronostratigraphic framework will be built by defining U-Pb zircon ages of unprecedented precision and accuracy for this region. This will permit testing of existing hypotheses of Gondwanan glaciation and will place constraints on the degree of synchronicity of the glaciations and establish the timing of terminal deglaciation in west-central Gondwana. Second, refined depositional and glaciation models will be developed through sedimentologic and detrital zircon provenance studies, integrated into the high-precision chronostratigraphic framework. This will place quantitative constraints on the timing, source, and geographic extent of glaciers feeding into the Parana Basin and permit reconstruction of changes in their glacial mass balance through time. Third, this research will develop U-Pb age-calibrated geochemical proxy records of continental climate variability that will test the hypothesis that major shifts in regional climate occurred in-step with periods of glacier advance/retreat and terminal deglaciation. This project will lead to a more complete understanding of icehouse to greenhouse transitions of the past.
 
 Qualitative Keywords:
-case study; case study",QUANTITATIVE,QUANTITATIVE,NON_QUALITATIVE,NON_QUALITATIVE,QUANTITATIVE</s>,CORRECT
+case study; case study",QUANTITATIVE,QUANTITATIVE,NON_QUALITATIVE,NON_QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 19,"Grant Abstract:
 This research will develop a foundational tool for understanding how civic technologies are used and how information inequalities manifest in a city.  User data from new civic technologies that reveal inequalities in the information environments of citizens has only recently become available. Since a large portion of data is demographically or geospatially biased due to varying human-data relationships, computational social scientists have used data modeling and algorithmic techniques to adjust the data and remove biases during data-processing. However, this approach limits our understanding of how and why biased information is created, and our ability to address urban information inequalities and biased data-creation. Consequently, as cities transition to e-government enabled by information and communication technology, they may project the inequities of the past into the smart cities of the future, so a fresh approach is needed. This innovative research analyzes and visualizes data from Boston's 311 system for reporting non-emergency issues to the city government, using computational and qualitative approaches to identify, categorize, and understand the kinds of information disparities that are becoming institutionalized by crowdsourced municipal systems, inhibiting smart city transitions, and perpetuating information deserts. For Boston and its citizens, this research could improve both the function and the equity of the city's 311 system. The resulting insights and tools could also inform other cities' implementation of smart city technologies, identify potential distortions in existing urban datasets, and surface potential corrections that could improve decision making and equitable delivery of services for all residents. 
 
@@ -248,7 +279,9 @@ The research will be performed in three phases. First, six years of civic, censu
 This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
 
 Qualitative Keywords:
-semi-structured interviews",QUALITATIVE,MIXED,QUALITATIVE,QUALITATIVE,QUALITATIVE</s>,CORRECT
+semi-structured interviews",QUANTITATIVE,MIXED,NON_QUALITATIVE,QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 20,"Grant Abstract:
 The research product will provide guidance to researchers by describing the ethical foundations of research practices and some of the personal and professional issues that researchers encounter in their work. Besides the key concepts provided in the earlier editions of the guide, the third edition of On Being a Scientist: Responsible Conduct in Research would address key issues that have emerged since the last edition in 1995. These include financial conflicts of interest, Internet and electronic publications, intellectual property, interdisciplinary research and publication, commercial influences on research agendas, management of human resources, and homeland security. 
 
@@ -259,21 +292,27 @@ The National Academies entity overseeing this committee is the Committee on Scie
 This project will incorporate National Academies Science and Technology Policy interns, who are graduate students and postdoctoral scholars in science and engineering, as part of education and training activities related to this study. The volume will provide guidance to all research disciplines on how to conduct responsible research, and how to respond to concerns regarding the activities of other researchers. The study committee will include representatives from underrepresented groups and a diverse array of academic institutions in its focus groups and workshops.
 
 Qualitative Keywords:
-focus groups",QUANTITATIVE,QUALITATIVE,NON_QUALITATIVE,QUALITATIVE,QUANTITATIVE</s>,CORRECT
+focus groups",QUANTITATIVE,QUALITATIVE,NON_QUALITATIVE,QUALITATIVE,"QUANTITATIVE]
+
+The grant",RESOLVABLE
 21,"Grant Abstract:
 In addition to being taught that engineering practice requires assuming liability for the direct performance of one's designs; students must also be trained to consider the ethical dimensions of their indirect obligations and liabilities. The indirect effects of a product, project, or policy can be characterized and quantified using life cycle assessment (LCA), which is a formal modeling method that utilizes a comprehensive ""cradle-to-grave"" approach to evaluate environmental and social impacts.  LCA is in wide use by designers, scientists and engineers, and businesses, primarily for use in product design and management, and is also employed in policy spheres to quantify the systemic impacts of large-scale engineering and technology decisions. While the use of LCA is widespread, the modeling structure and the interpretation of results involve ethical and value judgments that must be navigated carefully both by the analyst and by the receiver of the results.  This EESE project centers on the integration of ethical training into life cycle courses and the development of life cycle-based educational materials for general ethics training in engineering and science. Hypothetical and real-world cases are being developed that address a range of life cycle-oriented ethical challenges, with relevance for multiple disciplines. Instructional materials and video footage presenting each case, as well as shorter versions for younger audiences, are also being created and hosted at the Northeastern Ethics Institute as an additional teaching resource. Case studies are being submitted to ethics, engineering, science, policy, and business case study clearinghouses as well as additional dissemination through structured tutorials at national and international conferences.  One of these case studies is being converted into a three-hour workshop format at the University of Notre Dame and offered subsequently at one of its HBCU partner institutions.
 
 This project aims to achieve broad impacts inside and outside of the classroom. Most importantly, this project directly affects the professional development of students who will carry the insights, perspectives, and behaviors instilled by this ethics training into the workforce, to the ultimate benefit of society. The cases developed address fundamental ethical principles and macroethical issues; they will therefore be of value for ethics education in the engineering classroom even at universities without existing courses in LCA or science policy, including those who have adopted a workshop approach to graduate-level ethics education. Under-represented groups are being included both as participants on the project team and in several case-based ethics workshops. While the full cases are being designed for university students, shorter versions for secondary school students raise awareness of life cycle issues and environmental ethics early in formal STEM education.  Ultimately, this project advances ethics education for a diverse range of students in a way that reflects 21st century progress toward sustainable engineering and technology.
 
 Qualitative Keywords:
-case study; case studies",QUANTITATIVE,QUALITATIVE,NON_QUALITATIVE,QUALITATIVE,QUANTITATIVE</s>,CORRECT
+case study; case studies",QUANTITATIVE,QUALITATIVE,NON_QUALITATIVE,QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 22,"Grant Abstract:
 This grant is for travel support for six or more researchers from the U.S. to participate in the 12th International Conference on Light and Color in Nature in Granada, Spain.  For 38 years, researchers from around the world have been gathering at approximately three-year intervals to share the latest results of their investigations into optical phenomena observed in nature. These meetings have done much for enhancing science and education in atmospheric optics and related fields by being the foremost (and virtually only) forum for reporting advances in atmospheric and environmental optics.  This meeting has been particularly successful at motivating archival research papers and popular articles, films, and books on the subject of optics in nature. Each meeting is followed by a Light and Color in the Open Air feature issue of the Journal of the Optical Society of America or Applied Optics. In 2001, the Optical Society of America published a CD collection of the papers from the first 25 years of these conferences. Each conference includes a public session for K-12 students and teachers, typically attracting 200-300 outside attendees. Significantly motivated by the opportunities and interactions provided by these meetings, numerous participants have published books reaching out to people from scientists to the general public.
 
 The topics addressed at the meeting include, but are not entirely limited to, the following:  rainbows, ice crystal halos, glories, coronas, iridescence, sky color, atmospheric visibility, refraction effects, contrast phenomena, noctilucent clouds, optics of lightning, auroras, colors created by absorption and scattering in water and air, color and light in water and on water surfaces, iridescence and colors in biology and geology. Examples of recent publications from these meetings include the first documented photographs of the 3rd- and 4th-order rainbows, an explanation of new halo formations, measurement of coronas in ice clouds, a general theory for ice-crystal halo formation, model and experimental verification of halo polarization through ice birefringence, new computer models for quantitative studies of color variation with cloud optical depth and particle sizes, and the use of glitter patterns to study ocean-wave slope statistics.
 
 Qualitative Keywords:
-archival research",QUANTITATIVE,QUANTITATIVE,NON_QUALITATIVE,NON_QUALITATIVE,QUANTITATIVE</s>,CORRECT
+archival research",QUANTITATIVE,QUANTITATIVE,NON_QUALITATIVE,NON_QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 23,"Grant Abstract:
 Nontechnical Description of Significance and Importance
 
@@ -284,7 +323,9 @@ Technical Description
 Although functional coordination has long been a concern within public administration, these issues are not emphasized in contemporary policy theories. Little is known about how the design of administrative mechanisms influences organizational ability to integrate decisions and resolve functional collective action problems. Even less is known about how administrative mechanisms affect policy outputs and outcomes at the organizational level. Through an exploration of city sustainability policy, this research will initiate a theory of functional collective action that extends institutional collective action research beyond its current focus on horizontal and vertical fragmentation among independent governments. Findings will provide insight to address the common problem of ""fuzzy boundaries,"" whereby the lack of clear lines of responsibility for tackling complex policy issues necessitates more coordinated efforts. This research will systemically identify the strengths and weaknesses associated with different mechanisms for overcoming functional collective action and enable municipalities to make more informed choices and minimize administrative dilemmas within as well as between organizations. The results of this analysis are expected to be of applied value to local government practitioners. Additionally, the empirical survey data collected from this research will contribute to the broader study of urban governance and policy in the US and enable researchers to better examine sustainability and local government administration questions.
 
 Qualitative Keywords:
-qualitative analysis; case study; case studies",QUANTITATIVE,MIXED,NON_QUALITATIVE,QUALITATIVE,QUANTITATIVE</s>,CORRECT
+qualitative analysis; case study; case studies",QUANTITATIVE,MIXED,NON_QUALITATIVE,QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 24,"Grant Abstract:
 This Doctoral Dissertation Research Support investigation examines how increased party competition --- specifically the emergence of federal-state divided government --- has transformed the Mexican Federal System during the nineties. Riker (1964) suggests that one of the conditions that helps to maintain the federal bargain is if one national party controls the federal executive and shares with other parties control over the state executives, or, what might be called federal-state divided government. The rationale behind this proposition being that the constant possibility for the relevant parties to become the next federal or state leaders actually prevents them from invading each other's areas of responsibility.
 
@@ -295,7 +336,9 @@ The dissertation consists of two main parts. The first part deals with the trans
 Upon completion, the project will shed light on the operation of federal arrangements with an authoritarian history that have undergone a democratization process recently (e.g. Argentina, Brazil, Russia). We should also gain a deeper understanding of the relationships between democratization, increased party competition, and the federal system. The project will examine a critical but overlooked consequence of democratization processes: changes in the relationships among the center and the regions, and the consequences of these changes for policy. The data and information collected will be provided to the scholarly community at large.
 
 Qualitative Keywords:
-qualitative analysis",QUALITATIVE,MIXED,QUALITATIVE,QUALITATIVE,QUALITATIVE</s>,CORRECT
+qualitative analysis",QUANTITATIVE,MIXED,NON_QUALITATIVE,QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 25,"Grant Abstract:
 PROJECT SUMMARY
 In the US, Black women living with HIV/AIDS (WLHA) are less likely to be engaged in care, adherent to
@@ -330,7 +373,9 @@ promote engagement in HIV care, while improving social support through peers and
 under the auspices of being trauma-informed for Black WLHA with experiences of interpersonal violence.
 
 Qualitative Keywords:
-focus groups",QUALITATIVE,MIXED,QUALITATIVE,QUALITATIVE,QUALITATIVE</s>,CORRECT
+focus groups",QUANTITATIVE,MIXED,NON_QUALITATIVE,QUALITATIVE,"QUANTITATIVE]
+
+The grant",RESOLVABLE
 26,"Grant Abstract:
 Dr. Tobias Hecht will undertake the first, exploratory stage of an ethnographic study of the lifeworlds of infants, comparing those born to middle-class families, on the one hand, with those born into poverty, on the other. Ultimately, the project aims to examine how social and economic inequality is initially manifest and experienced: how, in other words, people first come to lead unequal lives. The fieldwork will be carried out in Florianópolis, Brazil, a city where many enjoy a first-world standard of living but where others endure extreme poverty. 
 
@@ -341,7 +386,9 @@ One of the goals of the project is to develop new research methods for the fledg
 This research is important because it has the potential to transform social scientific understanding of what inequality means and how it is experienced in everyday lives from their very beginning. Economists measure inequality above all in terms of household income. Sociologists have studied inequality in its class, racial and sexual dimensions. Here the objective is to suggest a new way of understanding inequality, one that takes into account the least studied group, the ones that cannot possibly be held accountable for their social and economic condition.
 
 Qualitative Keywords:
-fieldwork; ethnographic",QUALITATIVE,QUALITATIVE,QUALITATIVE,QUALITATIVE,QUALITATIVE</s>,CORRECT
+fieldwork; ethnographic",QUALITATIVE,QUALITATIVE,QUALITATIVE,QUALITATIVE,"QUALITATIVE]
+
+Output either",RESOLVABLE
 27,"Grant Abstract:
 ABSTRACT
 Alzheimer's Disease and its Related Dementias (AD/ADRD) are brain diseases whose immense human and
@@ -376,14 +423,18 @@ mental illnesses such as depression and schizophrenia; addiction; AD/ADRD; physi
 comparison subjects), as well as across professional and lay stakeholder groups.
 
 Qualitative Keywords:
-qualitative methods",QUALITATIVE,QUALITATIVE,QUALITATIVE,QUALITATIVE,QUALITATIVE</s>,CORRECT
+qualitative methods",QUANTITATIVE,QUALITATIVE,NON_QUALITATIVE,QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 28,"Grant Abstract:
 The goal of this U.S.-Romanian research project between Rodney M. Feldman and Carrie E. Schweitzer of Kent State University and Iuliana Lazar of the University of Bucharest is to expand our knowledge of the diversity of fossil decapods during Jurassic and Cretaceous time intervals when stem groups of the order experienced major diversification events that set the stage for the appearance, then expansion, of modern decapod fauna, such as crabs, lobsters and shrimp.  The team of U.S. and Romanian experts and students will jointly examine the sedimentological history and paleontology of four sites in the southern Carpathian Mountains, a region that has not been well studied due to previously limited access.  Stable isotope analyses and new data derived from the fieldwork will be combined to describe the taphonomic and paleoecological history of the assemblages.  Because these mountains lie at a crossroads between northern and western Europe, known to contain rich decapod faunas in the Jurassic and the Tethyan seaway to the south, the researchers hope to determine where the two major diversification events were centered.  Results are expected to enrich our understanding of the taxonomy, biostratigraphy, biogeography and evolution of decapods, a globally important group of organisms. 
 
 This project in paleontology fulfills the program objective of advancing scientific knowledge by enabling experts in the United States and Central Europe to combine complementary talents and share research resources in areas of strong mutual interest and competence.  Broader impacts include the introduction of U.S. students to the benefits of international collaboration through fieldwork at Carpathian sites and direct involvement in the project's analysis of ancient sediments and fossil decapod radiation.
 
 Qualitative Keywords:
-fieldwork",QUANTITATIVE,QUANTITATIVE,NON_QUALITATIVE,NON_QUALITATIVE,QUANTITATIVE</s>,CORRECT
+fieldwork",QUANTITATIVE,QUANTITATIVE,NON_QUALITATIVE,NON_QUALITATIVE,"QUANTITATIVE]
+
+Output either",RESOLVABLE
 29,"Grant Abstract:
 University of Florida graduate student, Stacey A. Giroux, under the direction of Dr. H. Russell Bernard, will undertake sociocultural research on how  changes in national dietary cultures are understood and acted upon at the level of the individual and household. There is abundant evidence that eating practices are changing worldwide, converging toward similar diets that are high in fat and sugar and low in fiber. Many nations also have escalating rates of overweight and obesity. This project will investigate the social and cultural foundations of this global phenomenon.
 
@@ -392,4 +443,6 @@ The research will be carried out in Loire region of France, a place with strong
 The research is signficant in the contribution it will make to the scientific understanding of the sociocultural pathways of changing world diets and their effects of health. The research also will contribute to the education of a graduate student.
 
 Qualitative Keywords:
-participant observation",QUALITATIVE,MIXED,QUALITATIVE,QUALITATIVE,QUALITATIVE</s>,CORRECT
+participant observation",QUALITATIVE,MIXED,QUALITATIVE,QUALITATIVE,"QUALITATIVE]
+
+Output either",RESOLVABLE

tokenizer_config.json

@@ -27,16 +27,15 @@
       "special": true
     }
   },
-  "additional_special_tokens": [],
   "bos_token": "<s>",
-  "chat_template": "{{ bos_token }}{% for message in messages %}{% if (message['role'] == 'user') != (loop.index0 % 2 == 0) %}{{ raise_exception('Conversation roles must alternate user/assistant/user/assistant/...') }}{% endif %}{% if message['role'] == 'user' %}{{ '[INST] ' + message['content'] + ' [/INST]' }}{% elif message['role'] == 'assistant' %}{{ message['content'] + eos_token + ' ' }}{% else %}{{ raise_exception('Only user and assistant roles are supported!') }}{% endif %}{% endfor %}",
+  "chat_template": "{% if messages[0]['role'] == 'system' %}{% set loop_messages = messages[1:] %}{% set system_message = messages[0]['content'] %}{% else %}{% set loop_messages = messages %}{% set system_message = false %}{% endif %}{% for message in loop_messages %}{% if (message['role'] == 'user') != (loop.index0 % 2 == 0) %}{{ raise_exception('Conversation roles must alternate user/assistant/user/assistant/...') }}{% endif %}{% if loop.index0 == 0 and system_message != false %}{% set content = '<<SYS>>\\n' + system_message + '\\n<</SYS>>\\n\\n' + message['content'] %}{% else %}{% set content = message['content'] %}{% endif %}{% if message['role'] == 'user' %}{{ bos_token + '[INST] ' + content.strip() + ' [/INST]' }}{% elif message['role'] == 'assistant' %}{{ ' '  + content.strip() + ' ' + eos_token }}{% endif %}{% endfor %}",
   "clean_up_tokenization_spaces": false,
   "eos_token": "</s>",
-  "legacy": true,
+  "legacy": false,
   "model_max_length": 1000000000000000019884624838656,
   "pad_token": "</s>",
+  "padding_side": "right",
   "sp_model_kwargs": {},
-  "spaces_between_special_tokens": false,
   "tokenizer_class": "LlamaTokenizer",
   "unk_token": "<unk>",
   "use_default_system_prompt": false

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bcb388f71d406ae8a46109bb32e8ec9fdc8fd046496cd64e095ed3b3aa8d5d79
+oid sha256:0c7e44fb0a0b26d6612f00f3b23ceff527e600eaaa8fe21069493968d5971cfd
 size 4728