Our Process & Methods
Appropriate Care Guide (ACG) process and methods
“Appropriate care guides” or ACGs provide concise and evidence-based recommendations on care practices and pathways to guide specific areas of clinical practice. Cost-effectiveness considerations are also incorporated where relevant. Where MOH Clinical Practice Guidelines (CPGs) are available, ACGs complement the CPGs by providing timely additions and updates as reflected in the evidence at the time of the ACG development.
The following are the main process steps which ACE follows in the development of an ACG:
ACG topics are selected based on topics raised by MOH divisions and relevant professional bodies in the annual call for topics. In addition, ACGs are also developed as extensions of technology guidances (e.g. drug guidance) issued by ACE.
Topics are shortlisted for development based on the following:
- Alignment with national health priorities
- Disease burden
- Evidence of suboptimal outcomes
- Practice variation
- Knowledge gap
- Potential impact on patient outcomes
Once topics are selected, an ACG expert group is appointed for each ACG topic to ensure that recommendations are accurate, current, and relevant for local practice and intended users. Each expert group consists of 8-12 practising health professionals who are subject matter experts including, but not limited to, specialists, general practitioners, pharmacists and nurses.
A step-wise approach is taken to review the literature, focusing on reviewing existing high-quality guidelines first before published literature. Reference guidelines are identified by the expert group and are assessed for quality using the AGREE II guideline assessment checklist.
Additional literature searches and appraisals of primary or secondary literature are undertaken if there are:
- Few or no guideline(s) available
- Gaps in the guidelines
- Important updates in the evidence
- Conflicting recommendations in the guidelines
Where applicable, cost-effectiveness considerations based on relevant technology guidances developed by ACE are included in the ACGs. Drugs or other medical technologies, available for subsidy through public healthcare institutions and primary care networks, are also highlighted in the ACGs.
Review and endorsement
Professional bodies such as the Academy of Medicine and the College of Family Physicians are invited to provide comments and endorse the ACGs.
Development time and review
The development of an ACG takes approximately 8-12 months.
ACGs are reviewed 3 years after publication, or earlier if new evidence emerges that requires substantive changes to the recommendations.
Health technology evaluation processes and methods
What is health technology assessment (HTA)?
HTA is an established scientific research methodology to inform policy and clinical decision-making on the relative value of new health technologies, such as drugs, devices and medical services, compared to existing standards of care. It is conducted using analytical frameworks, drawing on clinical, epidemiological and health economic information to determine how best to allocate limited healthcare resources.
HTA helps to answer the following questions:
- Does the health technology work?
- What benefit does it provide and for whom?
- What does it cost (to the healthcare service, to the patient, etc.), including opportunity costs?
- How does it compare with the available alternatives?
The goal of HTA is to inform the development of effective health policies about the use of health technologies in a manner that is patient-focused and achieves best value. ACE conducts HTAs to support subsidy decisions by the respective MOH advisory committees for two main technology streams:
- Drugs: Drug Advisory Committee (DAC)
- Medical technologies (including devices, diagnostics and medical services): Medical Technology Advisory Committee (MTAC).
There are currently 3 main process steps which ACE follows when evaluating health technologies to inform decision-making:
Topic submission and selection
A call for applications is put out annually to the public healthcare institutions to submit requests for subsidy consideration. ACE works with the DAC and MTAC to select the topics for evaluation.
Once a topic is selected, technical evaluations are conducted at 2 levels – expedited or full – depending on the estimated budget impact and uncertainty around the clinical and cost parameters for each technology. In the case of medical technologies, the complexity of the care pathway incorporating the use of the technology is also taken into consideration when deciding the type of evaluation. Most of the evaluations are conducted internally by the technical teams in ACE, with supporting evidence provided by local clinical experts and manufacturers.
- Higher cost technologies (estimated budget impact >$2 million a year) are typically subject to full evaluation which includes a systematic review of the clinical evidence, and economic modelling to estimate the cost-effectiveness of the technologies in the local context (where feasible);
- Technologies with lower budget impact are subject to expedited evaluations (without modelling), which are usually informed by published clinical evidence and international cost-effectiveness studies.
Value-based pricing is conducted in parallel with technology evaluations, if required, to ensure that the price of the technology recommended for subsidy represents a cost-effective use of healthcare resources and is commensurate with the technology’s value in Singapore’s context. Under this process, manufacturers are invited to submit their best cost prices for their technologies, which will inform ACE’s cost-effectiveness analyses and budget impact assessments.
The evidence in ACE’s technical evaluations informs the committees’ subsidy deliberations around 4 core decision-making criteria:
- Clinical need of patients and nature of the condition
- Clinical effectiveness and safety of the technology
- Cost-effectiveness (value for money) – the incremental benefit and cost of the technology compared to existing alternatives
- Estimated annual cost of the technology and the number of patients likely to benefit from the technology
A 5th criterion is also considered for medical technologies:
- Organisational feasibility – the potential impact of adopting the technology to the healthcare system
Other factors, including social, ethical and value judgments, may also inform the committees’ considerations.
On the basis of the available evidence, the committees recommend whether government subsidy should be given for a health technology through the respective financing scheme.
ACE’s Drug Evaluation Methods and Process Guide
(Version 1) and Medical Technologies Methods and Process Guide
(Version 1) outline the core processes and methods underpinning ACE’s assessment of clinical and economic evidence, and any other important factors impacting the adoption of the technologies, which are being considered for government subsidy. The guides also document value-based pricing processes and the committees’ decision-making frameworks.
Get Acrobat Readeropens in a new window
Get Acrobat Readeropens in a new window
Last updated on 1 October 2018