PMCF Explained: Mastering Post-Market Clinical Follow-up for Medical Device Compliance and Innovation

Table of Contents:
1. Introduction to PMCF: The Cornerstone of Post-Market Surveillance
1.1 Defining PMCF: What it is and why it matters
1.2 The Evolution of Medical Device Regulation and PMCF
2. The Regulatory Imperative: PMCF under the EU MDR (2017/745)
2.1 Connecting PMCF to the Clinical Evaluation Process
2.2 Understanding the PMCF Plan: A Strategic Document
2.3 The PMCF Report: Documenting Ongoing Safety and Performance
3. Designing an Effective PMCF Strategy: Methodologies and Activities
3.1 Proactive PMCF: Clinical Investigations and Registries
3.2 Reactive PMCF: Harnessing Real-World Data and User Feedback
3.3 Leveraging Existing Data: Scientific Literature and Vigilance Systems
4. Implementing PMCF: A Step-by-Step Approach for Manufacturers
4.1 Establishing PMCF Objectives: Clear Goals for Device Monitoring
4.2 Data Collection and Analysis: Ensuring Robust Evidence
4.3 Integrating PMCF with Risk Management and Quality Systems
5. Challenges and Solutions in PMCF Implementation
5.1 Resource Allocation and Expertise: Overcoming Constraints
5.2 Data Harmonization and Interpretation Across Diverse Sources
5.3 Navigating Notified Body Expectations and Regulatory Scrutiny
6. The Strategic Advantages of Robust PMCF Beyond Compliance
6.1 Driving Product Improvement and Innovation
6.2 Enhancing Market Confidence and Competitive Edge
6.3 Facilitating Global Market Access and Harmonization
7. Case Studies: PMCF in Practice Across Device Categories
7.1 Case Study 1: A Novel High-Risk Implantable Device
7.2 Case Study 2: A Mature Class IIa Software as a Medical Device (SaMD)
7.3 Case Study 3: A Commonly Used Class I Reusable Surgical Instrument
8. The Future of PMCF: Emerging Trends and Digital Transformation
8.1 The Role of Artificial Intelligence and Machine Learning in PMCF
8.2 Leveraging Digital Health Technologies and Connected Devices
8.3 Towards a More Integrated and Proactive Global Surveillance System
9. Conclusion: Embracing PMCF for Sustainable Medical Device Excellence

Content:

1. Introduction to PMCF: The Cornerstone of Post-Market Surveillance

The journey of a medical device does not conclude upon its market entry; in fact, its most critical phase of real-world assessment truly begins at this point. Manufacturers are entrusted with the profound responsibility of ensuring their products remain safe and perform as intended throughout their entire lifecycle, a commitment solidified by increasingly stringent global regulations. Central to this enduring oversight is Post-Market Clinical Follow-up, universally known as PMCF, a concept that has evolved from a recommended practice into a mandatory pillar of post-market surveillance for medical devices, particularly under the European Union’s Medical Device Regulation (EU MDR 2017/745).

PMCF represents a systematic and proactive collection and evaluation of clinical data from a marketed medical device. Its primary objective is to confirm the long-term safety and performance of the device, identify any previously unknown risks, evaluate the continued acceptability of the benefit-risk ratio, and detect any potential misuse or off-label use. This continuous feedback loop is indispensable for safeguarding patient health, demonstrating ongoing compliance with regulatory requirements, and fostering continuous improvement and innovation within the medical device industry. Without a robust PMCF strategy, manufacturers operate with a significant blind spot regarding their device’s real-world impact.

The significance of PMCF transcends mere regulatory checkboxes; it forms an integral part of a manufacturer’s quality management system and risk management process. By actively monitoring device performance in diverse clinical settings and patient populations, manufacturers gain invaluable insights that can lead to product enhancements, updated instructions for use, and even the prevention of adverse events. This comprehensive article delves into the intricacies of PMCF, exploring its regulatory framework, practical methodologies, implementation challenges, and the strategic advantages it offers to manufacturers committed to excellence in patient care.

1.1 Defining PMCF: What it is and why it matters

At its core, PMCF is a systematic process that gathers and assesses clinical data related to a medical device that has already been placed on the market. Unlike pre-market clinical investigations, which typically involve controlled environments and selected patient cohorts to establish initial safety and performance, PMCF extends this scrutiny to the broader, often more complex, real-world clinical landscape. It’s a proactive component of Post-Market Surveillance (PMS), specifically focusing on clinical aspects, meaning data directly related to patient outcomes, device effectiveness in actual use, and the incidence of adverse events or undesirable side effects that might not have been apparent during pre-market studies.

The importance of PMCF cannot be overstated in today’s medical device ecosystem. Devices are used by a wider range of patients, by different types of healthcare professionals, and in varied clinical settings, often for longer durations than initially tested. This expanded usage can reveal rare complications, long-term degradation issues, or specific patient population responses that were statistically improbable or not feasible to detect in limited pre-market trials. Moreover, advancements in medical technology are rapid, and devices become increasingly complex; PMCF ensures that their safety and efficacy profiles keep pace with their innovative capabilities, providing ongoing assurance to patients, healthcare providers, and regulatory authorities alike. It is the ultimate real-world validation of a device’s claims and its continued suitability for its intended purpose.

1.2 The Evolution of Medical Device Regulation and PMCF

The concept of monitoring medical devices post-market is not new, but its formalization and stringent requirements have significantly intensified over time. Historically, post-market surveillance activities, while present, often lacked the systematic, proactive clinical focus that PMCF now mandates. Under the older Medical Device Directives (MDD), the emphasis was largely on incident reporting and a more reactive approach to safety concerns. While manufacturers were expected to monitor their devices, the specific requirements for active clinical follow-up were less prescriptive, leading to variability in implementation across the industry.

The paradigm shift arrived definitively with the implementation of the EU Medical Device Regulation (MDR) 2017/745. Triggered by high-profile device failures and scandals that exposed gaps in the previous regulatory framework, the MDR introduced a much more robust and legally binding framework for post-market surveillance, placing PMCF squarely at its center. The MDR explicitly states that PMCF is a continuous process that updates the clinical evaluation, requiring manufacturers to continuously collect and assess clinical data. This evolution signifies a move towards a lifecycle approach to device safety and performance, demanding manufacturers not only demonstrate initial conformity but also maintain it through active and ongoing vigilance, thereby fostering greater transparency and accountability throughout the entire product lifecycle.

2. The Regulatory Imperative: PMCF under the EU MDR (2017/745)

The EU Medical Device Regulation (MDR) 2017/745 stands as the most influential regulatory framework dictating PMCF requirements globally, setting a high benchmark for medical device manufacturers. Under the MDR, PMCF is no longer an optional add-on but an indispensable, systematic, and continuous process that must be meticulously planned, executed, and documented. Article 83 of the MDR defines PMCF as a systematic process to proactively collect and evaluate clinical data from a CE-marked device when it is used as intended throughout its expected lifetime. This mandate underscores a fundamental shift towards a more rigorous and sustained demonstration of safety and performance, directly linking post-market activities to the initial clinical evaluation and technical documentation.

Manufacturers operating in the European market, or those seeking to place devices in the EU, must integrate PMCF deeply into their quality management systems. The MDR explicitly requires all Class I, IIa, IIb, and III devices to have a PMCF plan as part of their technical documentation. The intensity and nature of PMCF activities must be proportionate to the risk class of the device, its intended purpose, the novelty of its technology, and the availability of existing clinical data. This proportionality principle allows for flexibility but places the onus on the manufacturer to justify their chosen PMCF approach, ensuring it is sufficiently robust to maintain the validity of the clinical evaluation and the device’s CE marking. The regulatory spotlight on PMCF ensures that devices are not merely “safe by design” but remain “safe in practice” throughout their entire lifecycle.

The overarching goal of PMCF under the MDR is to continuously update the clinical evaluation, addressing residual risks, emerging risks, and confirming the long-term safety and performance of the device. This includes identifying needs for preventive or corrective actions, informing updates to the Instructions for Use (IFU), improving product design, and enhancing manufacturing processes. The insights derived from PMCF feed directly back into the manufacturer’s risk management system and clinical evaluation process, creating a dynamic feedback loop that ensures devices remain compliant with the General Safety and Performance Requirements (GSPRs) specified in Annex I of the MDR. This holistic integration ensures that regulatory compliance is not a static achievement but a continuous state of vigilance and adaptation.

2.1 Connecting PMCF to the Clinical Evaluation Process

The EU MDR establishes a symbiotic relationship between the Clinical Evaluation Report (CER) and PMCF. The CER, which must accompany all medical devices seeking CE marking, assesses the clinical safety and performance of a device based on pre-market data. However, this initial evaluation is inherently limited by the scope and duration of pre-market clinical investigations. PMCF bridges this gap by continuously collecting new clinical data after the device enters the market, thereby updating and validating the conclusions drawn in the initial CER. It’s not just an adjunct; it’s an extension and essential update to the clinical evaluation.

Manufacturers are required to explicitly identify in their PMCF Plan any open questions or uncertainties from the clinical evaluation that need to be addressed post-market. For instance, a pre-market study might show efficacy in a narrow patient group, but PMCF would then be designed to gather data on broader populations or long-term outcomes. This iterative process means that the CER is not a fixed document but a living one, frequently updated with PMCF data. This continuous update mechanism ensures that the documented clinical evidence for a device remains current, reflecting its real-world performance and safety profile, thereby maintaining the validity of the device’s conformity assessment and its CE mark.

2.2 Understanding the PMCF Plan: A Strategic Document

The PMCF Plan is the foundational document that outlines the strategy and methodology for conducting PMCF activities. It is a mandatory part of the technical documentation for all medical devices under the MDR and must be meticulously drafted before a device can be placed on the market. This plan is not merely a formality; it serves as a critical strategic blueprint, detailing how a manufacturer intends to proactively gather and evaluate clinical data throughout the device’s lifecycle. Its comprehensive nature is vital, as it reflects the manufacturer’s commitment to ongoing vigilance and continuous improvement.

A robust PMCF Plan, as specified in Annex XIV, Part B of the MDR, must include:
The methods and procedures for proactively collecting and evaluating clinical data, such as PMCF studies, clinical investigations, registries, or other suitable methods.
The methods and procedures for reactively collecting technical and scientific literature, experience gained by users, and information from vigilance and complaint handling.
Specific objectives that clearly define what clinical aspects will be investigated or confirmed. These objectives should often directly address residual risks identified during risk management or uncertainties raised in the initial clinical evaluation.
A detailed rationale for the chosen methods, considering the device’s risk class, novelty, and the available pre-market clinical data. It must justify why the selected PMCF activities are sufficient to address the defined objectives.
A schedule for PMCF activities and deliverables, including the frequency of PMCF Report updates.
This structured approach ensures that manufacturers adopt a systematic and measurable process for monitoring their devices post-market, making the PMCF Plan a living document that guides ongoing compliance efforts.

2.3 The PMCF Report: Documenting Ongoing Safety and Performance

Following the execution of the PMCF Plan, manufacturers are required to compile a PMCF Report. This report, detailed in Annex XIV, Part B of the MDR, systematically documents the results of all PMCF activities undertaken in accordance with the PMCF Plan. It serves as a crucial deliverable that demonstrates the manufacturer’s ongoing adherence to regulatory requirements and their commitment to device safety and performance. The PMCF Report summarizes the findings, draws conclusions, and outlines any necessary preventive or corrective actions taken or planned as a result of the collected data. Its importance cannot be overstated, as it represents the tangible output of the continuous clinical follow-up process.

The frequency of PMCF Report updates depends on the device’s risk class and the findings from the previous report. For high-risk devices (Class III and implantable devices), the PMCF Report is typically updated annually. For lower-risk devices, the update frequency may be longer but must be justified in the PMCF Plan. Key elements of a PMCF Report include a summary of the PMCF Plan, details of the methods used, data collected, results of the analysis (including any trends or emerging risks), and most importantly, conclusions drawn regarding the device’s continued conformity with the General Safety and Performance Requirements (GSPRs). This report directly influences updates to the CER, risk management file, and potentially the Instructions for Use, making it a pivotal document in the device’s lifecycle management and regulatory submission packages.

3. Designing an Effective PMCF Strategy: Methodologies and Activities

Developing an effective PMCF strategy is a nuanced task that requires a deep understanding of the device, its intended use, its risk profile, and the existing clinical evidence. There is no one-size-fits-all approach to PMCF; instead, manufacturers must tailor their strategy to be proportionate and appropriate for each specific device. The strategy encompasses a blend of proactive and reactive methods, all designed to systematically gather relevant clinical data and continuously assess the device’s safety and performance in the real world. A well-designed strategy not only ensures regulatory compliance but also yields valuable insights that can drive product innovation and market success. It demands careful consideration of resource allocation, data collection techniques, and analytical capabilities to ensure meaningful and actionable outcomes.

The core of an effective PMCF strategy lies in its ability to address the specific “open questions” identified in the clinical evaluation. These questions might pertain to long-term performance, safety in particular patient subgroups, the impact of new clinical practices, or the emergence of rare adverse events. Therefore, the selection of PMCF activities must directly correlate with these identified knowledge gaps, employing methods that are robust enough to generate statistically significant or clinically relevant data. This targeted approach prevents manufacturers from engaging in generic, box-ticking exercises and instead focuses efforts on areas that genuinely contribute to the understanding of the device’s real-world profile. The methods chosen must also be practical and ethically sound, ensuring patient privacy and data integrity are always paramount.

Furthermore, an effective PMCF strategy should be dynamic and adaptable, capable of evolving as new data emerges or as regulatory expectations change. It is not a static plan that is executed once; rather, it is a continuous cycle of planning, data collection, analysis, and reporting, with each cycle potentially informing adjustments to the next. This iterative nature ensures that the PMCF strategy remains relevant and effective throughout the entire lifespan of the medical device. Manufacturers must regularly review and update their PMCF Plans and Reports, demonstrating a proactive commitment to device vigilance and a willingness to integrate new findings into their ongoing clinical evaluation and risk management processes. The successful implementation of such a strategy demands cross-functional collaboration, involving clinical, regulatory, quality, and R&D teams.

3.1 Proactive PMCF: Clinical Investigations and Registries

Proactive PMCF activities involve deliberately initiating studies or data collection efforts to generate new clinical data specific to the device. These methods are typically employed when there are significant uncertainties remaining from the pre-market clinical evaluation, particularly for novel, high-risk, or implantable devices, or when long-term performance data is crucial. The investment in proactive PMCF can be substantial, but the quality and specificity of the data obtained are often unparalleled.

One of the most robust forms of proactive PMCF is a PMCF clinical investigation. These are structured studies, similar to pre-market clinical trials but conducted on a device already on the market, specifically designed to address outstanding clinical questions. For example, a manufacturer of a novel cardiac stent might initiate a PMCF clinical investigation to gather five-year patency data in a broader, more heterogeneous patient population than was feasible pre-market. These studies typically require ethical approval, patient consent, and adherence to Good Clinical Practice (GCP) guidelines. Another powerful proactive tool is the use of medical device registries. Registries systematically collect data on specific devices or procedures from multiple centers over extended periods. For instance, an orthopedic implant manufacturer might contribute data to a national joint replacement registry to monitor long-term implant survival rates, revision surgeries, and patient-reported outcomes across thousands of patients. While demanding to set up and maintain, registries offer a wealth of real-world evidence that can significantly bolster the clinical evidence base for a device.

3.2 Reactive PMCF: Harnessing Real-World Data and User Feedback

Reactive PMCF activities focus on leveraging existing data sources that are generated as part of routine clinical practice or through spontaneous reporting mechanisms. While termed “reactive,” these activities still require a systematic approach to collection, analysis, and interpretation to be effective. They are often more cost-efficient than proactive studies and can provide broad insights into device performance across a large user base.

A primary source of reactive PMCF data is Real-World Data (RWD). This includes data derived from electronic health records (EHRs), insurance claims and billing activities, product registries (if not considered proactive), and data generated from digital health devices. For example, a manufacturer of a continuous glucose monitor (CGM) might analyze anonymized data from thousands of users to identify trends in sensor accuracy under various environmental conditions or user handling patterns. User surveys and feedback mechanisms are another critical reactive component. Direct feedback from healthcare professionals and patients, collected via surveys, interviews, or dedicated feedback channels, can uncover usability issues, unexpected side effects, or benefits that might not be captured through other data streams. Analyzing complaint data, adverse event reports, and vigilance data also falls under reactive PMCF, providing insights into specific issues and allowing for timely identification of trends or clusters of problems.

3.3 Leveraging Existing Data: Scientific Literature and Vigilance Systems

Beyond newly generated data, an effective PMCF strategy mandates the systematic review and analysis of existing publicly available information. This includes a thorough and ongoing review of scientific literature, as well as the manufacturer’s internal vigilance and complaint data. These sources provide valuable context and can highlight emerging issues or provide comparative data for similar devices already on the market, enriching the overall understanding of the device’s risk-benefit profile.

A crucial element is the systematic literature review. This involves regularly searching scientific databases for publications related to the manufacturer’s device, similar devices, or the underlying medical condition. For instance, a manufacturer of a surgical mesh might regularly scan for new studies on mesh-related complications or long-term outcomes, even if not specific to their exact product. This helps identify new risks, understand the natural progression of conditions treated by the device, and stay abreast of the clinical consensus. Furthermore, manufacturers must integrate data from their vigilance and complaint handling systems into their PMCF evaluation. Analyzing aggregated incident reports, customer complaints, and field safety corrective actions (FSCAs) for trends is essential. This data provides direct feedback on device malfunctions, user errors, and adverse events occurring in real-world settings, serving as early warning signals for potential safety or performance issues that require immediate attention and potentially a refinement of the PMCF strategy itself. The insights from these systems, when combined, create a holistic view of the device’s post-market landscape.

4. Implementing PMCF: A Step-by-Step Approach for Manufacturers

Implementing PMCF is a complex, multi-faceted process that demands meticulous planning, robust execution, and continuous oversight. It requires more than just collecting data; it involves strategic thinking, cross-functional collaboration, and a deep understanding of regulatory expectations. Manufacturers must approach PMCF systematically, integrating it into their existing quality management system to ensure that all activities are documented, traceable, and align with their overall compliance strategy. This step-by-step approach ensures that PMCF is not merely a reactive response to regulatory demands but a proactive mechanism for ensuring device safety and driving continuous improvement throughout the entire product lifecycle.

The successful implementation of PMCF begins long before the device even hits the market, with preliminary planning often starting during the development phase as part of the initial clinical evaluation. This early integration allows manufacturers to identify potential data gaps and formulate a robust PMCF strategy from the outset, rather than trying to retrofit it later. Key steps involve establishing clear objectives, selecting appropriate methodologies, designing efficient data collection and analysis processes, and critically, integrating these activities with other core quality and risk management functions. Without a clear roadmap and dedicated resources, PMCF can become an overwhelming and ineffective exercise, failing to yield the necessary clinical evidence or meet regulatory scrutiny.

Furthermore, effective PMCF implementation requires ongoing commitment and the allocation of sufficient human and financial resources. It’s a continuous process that demands regular review, adaptation, and reporting. Manufacturers must foster a culture of vigilance and data-driven decision-making, ensuring that insights gained from PMCF are effectively communicated across relevant departments—from R&D and manufacturing to regulatory affairs and marketing. This holistic approach ensures that PMCF not only fulfills regulatory obligations but also becomes a valuable asset for strategic product management and patient safety, ultimately contributing to the long-term success and reputation of the medical device company.

4.1 Establishing PMCF Objectives: Clear Goals for Device Monitoring

The cornerstone of any effective PMCF strategy is the establishment of clear, measurable, achievable, relevant, and time-bound (SMART) objectives. These objectives are not generic but specific to the individual medical device and directly derived from the gaps, uncertainties, and residual risks identified during the initial clinical evaluation. Vague objectives will lead to unfocused data collection and inconclusive results, rendering the entire PMCF effort inefficient and potentially non-compliant.

For instance, if a new material for an implantable device was introduced, an objective might be “To assess the long-term biocompatibility and degradation profile of the novel implant material in a real-world patient population over a five-year period.” Another objective could be “To confirm the continued effectiveness of the device in reducing patient symptoms across diverse demographic groups not fully represented in pre-market studies.” These objectives guide the selection of appropriate PMCF methods, the design of data collection tools, and the subsequent analysis plan. They provide a clear focus for the entire PMCF process, ensuring that the manufacturer gathers relevant data that truly addresses the outstanding clinical questions and validates the ongoing safety and performance claims of their device in its intended clinical environment.

4.2 Data Collection and Analysis: Ensuring Robust Evidence

Once objectives are defined, the next critical step is to design and implement robust processes for data collection and analysis. The quality and integrity of the data collected directly impact the validity of the PMCF conclusions. This involves selecting appropriate data sources and collection tools, ensuring data privacy and security, and establishing rigorous methods for data analysis and interpretation. The chosen methods must be capable of generating data that is statistically sound and clinically meaningful to address the PMCF objectives.

Data collection might involve various instruments, from structured questionnaires and patient-reported outcome measures (PROMs) to direct observation in clinical settings or the extraction of anonymized data from electronic health records or device logs. Manufacturers must ensure that data collection adheres to ethical guidelines, data protection regulations (like GDPR), and relevant standards for data quality. Following data collection, a systematic approach to analysis is paramount. This may involve statistical analysis of quantitative data (e.g., survival rates, adverse event frequencies), qualitative analysis of user feedback, or trend analysis of vigilance data. The results of this analysis must then be carefully interpreted in the context of the device’s clinical evaluation and risk management file, drawing clear conclusions regarding the device’s ongoing safety and performance and identifying any new or increased risks that necessitate further action.

4.3 Integrating PMCF with Risk Management and Quality Systems

PMCF is not a standalone activity; its strength and utility are greatly enhanced when it is seamlessly integrated into a manufacturer’s broader Quality Management System (QMS) and Risk Management (RM) processes. The EU MDR emphasizes this integration, making it a regulatory expectation. Data derived from PMCF must directly feed into and update these systems, creating a continuous improvement loop that strengthens the overall safety and compliance framework for the device.

Specifically, findings from PMCF activities should inform updates to the device’s risk management file. If new risks are identified or existing risks are re-evaluated based on real-world data, the risk-benefit analysis must be updated, and appropriate risk control measures may need to be implemented or revised. This might lead to changes in the device’s design, manufacturing processes, labeling, or Instructions for Use. Furthermore, PMCF data provides critical input for management reviews and internal audits, allowing organizations to assess the effectiveness of their QMS in monitoring device performance. This integration ensures that PMCF is not just a reporting exercise but a vital operational process that directly influences product design, manufacturing, post-market activities, and ultimately, patient safety, embodying a truly lifecycle approach to medical device management.

5. Challenges and Solutions in PMCF Implementation

While the benefits and regulatory necessity of PMCF are clear, its effective implementation is often fraught with significant challenges for medical device manufacturers. These hurdles can range from internal resource constraints and data management complexities to navigating the intricate expectations of Notified Bodies and continuously adapting to an evolving regulatory landscape. Overcoming these challenges requires strategic foresight, robust planning, and a commitment to investing in the necessary infrastructure and expertise. Many manufacturers, especially smaller and medium-sized enterprises (SMEs), find the shift from predominantly pre-market focus to a continuous post-market vigilance framework particularly demanding, necessitating a fundamental change in operational mindset and allocation of resources.

One of the primary difficulties lies in the sheer volume and diversity of data that needs to be collected, processed, and analyzed from real-world settings. Unlike controlled clinical trials, PMCF data can be messy, incomplete, or inconsistent, originating from various sources such as electronic health records, patient registries, spontaneous reports, and user surveys. Harmonizing and interpreting this disparate data to draw meaningful and actionable conclusions requires sophisticated analytical capabilities and robust IT infrastructure. Additionally, maintaining patient privacy and data security while collecting and utilizing sensitive health information adds another layer of complexity, demanding adherence to stringent data protection regulations and ethical considerations. These operational complexities necessitate a structured approach and often external expertise.

Moreover, the dynamic nature of regulatory expectations and the need for ongoing dialogue with Notified Bodies introduce further challenges. What constitutes “sufficient” PMCF for a given device can be subjective and may evolve over time. Manufacturers must therefore be prepared for iterative discussions and potential requests for additional data or modifications to their PMCF plans. Developing proactive strategies to address these challenges, rather than reacting to them, is crucial for maintaining compliance, ensuring market access, and ultimately, safeguarding patient safety. This means not just identifying the problems, but actively developing and deploying sustainable solutions that integrate seamlessly into the overall business operations.

5.1 Resource Allocation and Expertise: Overcoming Constraints

A significant hurdle for many medical device manufacturers is the allocation of adequate resources – both human and financial – to effectively conduct PMCF activities. PMCF is a continuous process that demands specialized skills in clinical research, biostatistics, regulatory affairs, data management, and scientific writing. Small to medium-sized enterprises (SMEs), in particular, often struggle to build and maintain dedicated internal teams with the requisite expertise, leading to potential gaps in their PMCF strategies or delays in report generation.

To overcome these resource constraints, manufacturers can adopt several strategies. One effective approach is to leverage external expertise through specialized Contract Research Organizations (CROs) or regulatory consultants who possess deep knowledge of PMCF requirements and methodologies. These partners can assist with everything from PMCF plan development and study design to data collection, statistical analysis, and report writing, thereby complementing internal capabilities without the need for significant permanent headcount increases. Furthermore, implementing efficient digital tools and platforms for data collection and management can automate repetitive tasks, reduce manual effort, and free up internal personnel to focus on higher-value activities such as data interpretation and strategic planning. Investing in training existing staff on PMCF principles and specific analytical software can also enhance internal capabilities over time, fostering a more self-sufficient and knowledgeable team capable of managing ongoing PMCF efforts effectively.

5.2 Data Harmonization and Interpretation Across Diverse Sources

The heterogeneity of data sources presents a substantial challenge in PMCF. Clinical data can originate from structured clinical investigations, unstructured patient feedback, electronic health records (EHRs) with varying formats, and diverse national registries, each with its own data standards and reporting conventions. Reconciling these disparate datasets to produce a coherent and robust body of evidence is a complex undertaking, often requiring advanced data science capabilities and meticulous attention to detail.

To address issues of data harmonization, manufacturers should prioritize establishing clear data collection protocols and standardization efforts from the outset. Where possible, utilizing common data models or developing internal data dictionaries can facilitate the integration of information from different sources. Advanced analytical techniques, including natural language processing (NLP) for unstructured text data (like physician notes or patient comments) and machine learning algorithms, can help extract meaningful insights from large and varied datasets. Furthermore, a multi-disciplinary team comprising clinical experts, statisticians, and data scientists is essential for interpreting the results accurately, ensuring that conclusions drawn from the aggregated data are clinically relevant and scientifically sound. This collaborative approach helps to bridge the gap between raw data and actionable intelligence, transforming complex information into clear updates for the clinical evaluation and risk management files.

5.3 Navigating Notified Body Expectations and Regulatory Scrutiny

Manufacturers often face challenges in understanding and meeting the evolving expectations of Notified Bodies (NBs) regarding PMCF. While the MDR provides a framework, the interpretation and specific requirements for demonstrating “sufficient” clinical evidence through PMCF can vary, and NBs are increasingly scrutinizing PMCF plans and reports during conformity assessment. This necessitates clear communication, a proactive approach to addressing potential gaps, and a robust justification for the chosen PMCF strategy.

A key solution is to engage in early and continuous dialogue with the chosen Notified Body, especially for novel or high-risk devices. Seeking scientific advice or pre-submission meetings can help clarify expectations and gain alignment on the proposed PMCF strategy. Manufacturers must be prepared to articulate the rationale behind their selected PMCF methods, explaining how they adequately address the specific clinical questions and risks associated with their device. Comprehensive documentation, including a meticulously detailed PMCF Plan and an evidence-based PMCF Report, is paramount to withstand scrutiny. Manufacturers should also anticipate that NBs may challenge the adequacy of data or the robustness of analysis, requiring them to have contingency plans for additional data collection or more in-depth analyses. Staying updated on relevant MDCG guidance documents and best practices also helps manufacturers align their strategies with current regulatory thinking, minimizing the risk of non-conformities during assessment and ensuring a smoother path to CE marking and market access.

6. The Strategic Advantages of Robust PMCF Beyond Compliance

While regulatory compliance is the primary driver for implementing PMCF, viewing it solely as a burden misses a significant strategic opportunity. A robust and well-executed PMCF strategy offers a myriad of advantages that extend far beyond simply meeting legal obligations, transforming it into a powerful tool for business growth, product differentiation, and long-term success in the competitive medical device market. Manufacturers who embrace PMCF proactively often find themselves in a stronger position, not only in terms of regulatory standing but also in market perception and product innovation capabilities. This forward-thinking approach shifts PMCF from a cost center to a value-generating activity, yielding dividends across multiple facets of the organization.

Beyond ticking regulatory boxes, PMCF generates invaluable real-world evidence about device performance, patient outcomes, and user experiences that would otherwise be unattainable. This data is a goldmine for internal teams, feeding directly into research and development, marketing, and sales strategies. It allows manufacturers to identify areas for product improvement, validate marketing claims with concrete evidence, and gain a deeper understanding of patient needs and clinical workflows. Such insights enable data-driven decision-making, leading to more targeted product enhancements and the development of next-generation devices that genuinely address unmet clinical needs. In essence, PMCF fosters an ecosystem of continuous learning and adaptation, positioning the manufacturer as a leader committed to excellence and patient safety.

Ultimately, a strong PMCF program builds trust and credibility with patients, healthcare providers, and regulatory bodies. Demonstrating a proactive commitment to ongoing safety and performance monitoring distinguishes a manufacturer in a crowded market. It signals a dedication to quality and transparency, which can significantly enhance a brand’s reputation and foster stronger relationships with key stakeholders. In an era where patient safety is paramount and regulatory scrutiny is at an all-time high, leveraging PMCF as a strategic asset can provide a significant competitive advantage, opening doors to new markets and strengthening existing ones, thereby securing a sustainable future for the medical device company.

6.1 Driving Product Improvement and Innovation

The detailed insights garnered from PMCF activities are an unparalleled resource for driving product improvement and fostering innovation. Real-world data reveals how devices perform in diverse clinical scenarios, often highlighting subtle nuances in usability, durability, or patient response that pre-market studies might not capture. For example, consistent feedback on a particular aspect of device handling might indicate a need for ergonomic redesign, while long-term performance data might suggest improvements in material science to enhance longevity. This direct feedback loop from the market allows manufacturers to make informed, evidence-based decisions about product iterations and future developments.

Moreover, by actively monitoring device performance and patient outcomes, manufacturers can identify emerging clinical needs or opportunities for feature enhancements that differentiate their products. Understanding specific challenges faced by healthcare professionals or patients through PMCF can inspire the development of entirely new functionalities or even next-generation devices that offer superior solutions. This proactive identification of improvement areas and innovation opportunities, directly stemming from real-world usage, allows companies to stay ahead of the curve, develop more effective and user-friendly products, and ultimately contribute more meaningfully to patient care, solidifying their position as market leaders.

6.2 Enhancing Market Confidence and Competitive Edge

In an increasingly competitive and regulated landscape, a robust PMCF program serves as a powerful differentiator, significantly enhancing market confidence and providing a crucial competitive edge. When a manufacturer can consistently demonstrate, through well-documented PMCF reports, that their devices maintain their safety and performance profile over time and in real-world use, it instills greater trust among healthcare providers, procurement bodies, and patients. This sustained assurance goes beyond initial CE marking; it’s a testament to ongoing quality and commitment.

This heightened confidence can translate into tangible business benefits. Hospitals and healthcare systems are more likely to adopt and standardize devices from manufacturers with a proven track record of transparent and effective post-market surveillance. Furthermore, positive clinical data derived from PMCF can be leveraged in marketing and sales efforts (within regulatory guidelines), substantiating claims of long-term efficacy and safety. This allows manufacturers to articulate a compelling value proposition that resonates with decision-makers who prioritize patient safety and reliable device performance. A strong PMCF reputation effectively mitigates market risks associated with safety concerns and can act as a barrier to entry for less vigilant competitors, solidifying the manufacturer’s position in key markets.

6.3 Facilitating Global Market Access and Harmonization

While the EU MDR has driven much of the current focus on PMCF, the trend towards enhanced post-market surveillance is increasingly global. Regulatory bodies worldwide are recognizing the importance of continuous monitoring to ensure device safety throughout its lifecycle. A well-established and comprehensive PMCF system, designed to meet MDR requirements, can serve as a strong foundation for demonstrating compliance in other major markets, thereby streamlining global market access.

Many non-EU regulatory bodies, such as the FDA in the United States and health authorities in Australia, Canada, and Japan, are also moving towards more rigorous post-market oversight, including requirements for post-market studies and active surveillance. By implementing a PMCF strategy that is robust and adaptable, manufacturers can leverage the data and processes developed for the EU market to address similar requirements in other jurisdictions. This harmonization of effort reduces redundancy, saves resources, and accelerates market entry into multiple regions. Essentially, the investment in a strong PMCF system for MDR compliance becomes a strategic advantage for global expansion, allowing manufacturers to navigate complex international regulatory landscapes more efficiently and effectively, ensuring broader patient access to safe and effective medical technologies.

7. Case Studies: PMCF in Practice Across Device Categories

Understanding PMCF in theory is one thing, but seeing how it applies to different types of medical devices in practical scenarios can illuminate its diverse applications and underscore its importance. The nature and intensity of PMCF activities are highly dependent on the device’s risk class, its novelty, the duration of its intended use, and the specific clinical questions that need to be addressed. What constitutes an adequate PMCF strategy for a high-risk implantable device will differ significantly from that for a low-risk, non-invasive diagnostic tool. These case studies aim to illustrate how PMCF principles translate into actionable plans across a spectrum of medical device categories, offering concrete examples of objectives, methodologies, and expected outcomes.

Each case study will highlight the unique challenges and considerations for PMCF in its respective device category, demonstrating how manufacturers tailor their approach to be proportionate and effective. This includes considering the target patient population, the critical safety and performance parameters, and the potential for long-term complications or device degradation. The examples are designed to showcase the iterative nature of PMCF, where initial findings can lead to adjustments in the plan, further investigations, or product enhancements. They emphasize that PMCF is not a static endeavor but a dynamic process that continuously refines the understanding of a device’s real-world profile and ensures its ongoing safety and efficacy for patients.

These illustrative cases are not exhaustive but rather representative, demonstrating the versatility and criticality of PMCF as a continuous feedback mechanism. By examining how different manufacturers might approach PMCF for various device types, we gain a deeper appreciation for the nuanced decision-making involved in designing a compliant and strategically valuable post-market surveillance system. The lessons learned from these examples can be broadly applied, helping manufacturers irrespective of their device portfolio to construct more effective and responsive PMCF frameworks.

7.1 Case Study 1: A Novel High-Risk Implantable Device

Consider “CardioFlow,” a novel Class III implantable pulsatile ventricular assist device (PVAD) designed to support cardiac function in patients with severe heart failure awaiting transplant. As a life-sustaining, high-risk, and technologically innovative device, CardioFlow requires an exceptionally robust PMCF strategy to address long-term performance, potential complications unique to its novel design, and patient quality of life.

PMCF Objectives for CardioFlow:
1. To assess the long-term mechanical durability and reliability of the device components, particularly the pulsatile mechanism and drive-line integrity, over a five-year period post-implantation.
2. To monitor the incidence of device-related infections, thrombus formation, and neurological events in a broader patient population than initially studied.
3. To evaluate the impact of the device on patient-reported quality of life (QoL) and functional status in various patient demographics.
4. To identify any unforeseen interactions with concomitant medications or changes in patient management practices post-market.

PMCF Methods for CardioFlow:
The manufacturer launched a prospective, multi-center PMCF clinical investigation involving 500 patients across 20 specialized cardiac centers. This study collected detailed clinical data at 6-month intervals for five years, including device interrogation data, laboratory results, adverse event reporting, and validated QoL questionnaires. Concurrently, they established a dedicated device registry, enrolling all patients receiving CardioFlow, collecting anonymized real-world data on device function, patient characteristics, and clinical outcomes from participating hospitals. Regular literature reviews specifically focused on PVAD technology and cardiac failure management were conducted to identify emerging risks or best practices. Additionally, a proactive user feedback system via specialized clinical support teams ensured continuous communication with implanters and patients, capturing any immediate concerns or suggestions regarding device usability and patient experience. The manufacturer also actively participated in an industry-wide data sharing initiative for heart assist devices to benchmark performance and identify systemic issues.

Outcomes and Impact:
After three years, the PMCF study identified a statistically significant, albeit low, incidence of a specific type of drive-line wear not predicted by pre-market testing, particularly in patients with higher activity levels. The registry data corroborated this trend. This led to a design modification to the drive-line, a software update to optimize pulsatile flow parameters, and an update to the Instructions for Use (IFU) providing enhanced patient education on drive-line care. The QoL data provided valuable insights for patient selection criteria and led to the development of tailored rehabilitation protocols. The proactive PMCF not only ensured ongoing compliance but also significantly enhanced device safety and informed future product generations, strengthening the manufacturer’s reputation as a responsible innovator.

7.2 Case Study 2: A Mature Class IIa Software as a Medical Device (SaMD)

Consider “DiagnoMind,” a Class IIa Software as a Medical Device (SaMD) that assists clinicians in diagnosing early-stage diabetic retinopathy from retinal scans. DiagnoMind has been on the market for several years and has a well-established safety profile. However, with evolving AI algorithms and integration into various EHR systems, continuous PMCF is essential to confirm its performance, address potential bias, and monitor cybersecurity aspects.

PMCF Objectives for DiagnoMind:
1. To monitor the diagnostic accuracy (sensitivity and specificity) of the SaMD in real-world clinical settings, accounting for variations in retinal scan quality across different imaging devices.
2. To identify any emerging biases in diagnostic performance related to patient demographics (e.g., ethnicity, age) that may not have been fully captured in training datasets.
3. To track the frequency and nature of software glitches, integration issues, or cybersecurity vulnerabilities reported by users.
4. To gather feedback on user interface (UI) and user experience (UX) to inform future software updates and usability enhancements.

PMCF Methods for DiagnoMind:
The manufacturer implemented a continuous data collection strategy. They partnered with five large ophthalmology clinics that routinely use DiagnoMind to implement a retrospective data analysis project, comparing DiagnoMind’s performance against human expert diagnoses on a subset of anonymized real-world cases. This proactive method helped assess accuracy variations. Reactively, a robust feedback portal within the software allowed users to report bugs, suggest features, and rate their experience. This portal was integrated with the complaint handling system. Cybersecurity incident logs were continuously monitored, and regular literature reviews focused on new AI diagnostic algorithms for ophthalmology and cybersecurity threats relevant to SaMDs. Furthermore, anonymized, aggregated usage data from the software platform itself provided insights into feature adoption rates and user interaction patterns, without compromising patient privacy.

Outcomes and Impact:
Over a 12-month PMCF cycle, the data analysis revealed that while overall accuracy remained high, a subtle but persistent underperformance was noted for scans originating from older generation imaging devices, particularly in patients with advanced cataracts. This finding prompted the development of an adaptive algorithm update to improve performance with lower-quality input images and an alert system to warn users about potential limitations. User feedback highlighted a desire for more customizable reporting features, leading to their inclusion in the next software iteration. Crucially, PMCF activities confirmed the absence of significant demographic bias in the diagnostic algorithm and identified minor cybersecurity vulnerabilities that were promptly patched. The continuous PMCF ensured DiagnoMind remained competitive, highly accurate, and secure, adapting to real-world clinical diversity and demonstrating a commitment to continuous improvement in a rapidly evolving digital health landscape.

7.3 Case Study 3: A Commonly Used Class I Reusable Surgical Instrument

Consider “PrecisionForce,” a Class I reusable surgical forcep used in general surgery for grasping and manipulating tissues. While classified as low-risk, as a reusable instrument, its safety and performance depend heavily on its durability, resistance to degradation after repeated sterilization cycles, and ergonomic design. PMCF for such a device focuses on ensuring these aspects are maintained over its expected lifespan.

PMCF Objectives for PrecisionForce:
1. To monitor the mechanical integrity and functionality of the forcep (e.g., jaw alignment, tip wear, spring tension) after a high number of reprocessing cycles in various clinical settings.
2. To identify any material degradation, corrosion, or fatigue issues that could compromise patient safety or instrument effectiveness over time.
3. To collect user feedback on the ergonomics, ease of cleaning, and overall satisfaction of the instrument from surgical teams and sterile processing departments.
4. To track the incidence of complaints related to device breakage, malfunction during use, or issues encountered during sterilization.

PMCF Methods for PrecisionForce:
For PrecisionForce, the manufacturer primarily relied on structured user surveys and direct feedback. They implemented an online feedback form accessible via QR codes on product packaging and a dedicated section on their website for surgical nurses and sterile processing technicians to report issues. Targeted surveys were sent annually to a panel of 200 key opinion leader surgeons and sterile processing managers across different hospitals to specifically gather data on instrument durability, cleaning efficacy, and long-term performance. Additionally, the manufacturer partnered with three large hospitals to conduct a “sample return program,” where a subset of used forceps, after a specified number of sterilization cycles, were returned for engineering inspection and analysis of material fatigue and wear. All internal complaint and vigilance data related to surgical instruments were aggregated and analyzed quarterly to identify any trends in breakage or reprocessing difficulties. Scientific literature review focused on best practices for instrument reprocessing and common failure modes of reusable surgical tools.

Outcomes and Impact:
The PMCF activities for PrecisionForce revealed that while overall performance was satisfactory, approximately 2% of returned forceps showed microscopic pitting after an unusually high number of intense flash sterilization cycles, potentially impacting their long-term integrity. User surveys highlighted that while the ergonomics were excellent, the specific texture on the handle, while aiding grip, made thorough cleaning slightly more challenging in certain areas. Based on these findings, the manufacturer updated the IFU with revised guidance on optimal sterilization protocols, particularly emphasizing proper drying techniques to prevent pitting. They also launched a minor product revision featuring a smoother yet equally grippy handle texture to facilitate cleaning. This PMCF allowed the manufacturer to proactively address potential issues, reinforce confidence in their reusable instruments, and demonstrate continuous improvement, ensuring their product remained a trusted choice in operating rooms by effectively managing risks associated with reprocessing and long-term use.

8. The Future of PMCF: Emerging Trends and Digital Transformation

The landscape of medical device regulation and surveillance is continuously evolving, driven by rapid technological advancements, increasing data generation capabilities, and a global harmonization imperative. PMCF, in particular, is poised for significant transformation, moving beyond traditional data collection methods to embrace the power of digital health technologies, artificial intelligence (AI), and machine learning (ML). This evolution is not merely about adopting new tools but represents a fundamental shift towards more proactive, predictive, and personalized post-market monitoring. Manufacturers who strategically invest in these emerging trends will be better positioned to meet future regulatory demands, optimize device performance, and deliver superior patient outcomes, staying at the forefront of innovation in medical technology.

The increasing interconnectedness of healthcare systems, coupled with the proliferation of smart medical devices and wearable sensors, is generating unprecedented volumes of real-world data (RWD). This wealth of information presents both a challenge and an immense opportunity for PMCF. The ability to collect, aggregate, and analyze RWD from diverse sources in near real-time offers the potential to detect safety signals much earlier, understand device performance in varied patient populations, and personalize risk assessments. However, harnessing this data effectively requires sophisticated analytical capabilities, robust cybersecurity measures, and clear ethical frameworks to ensure patient privacy and data integrity. The future of PMCF will heavily rely on the strategic integration of these digital capabilities, transforming it into a more dynamic and insightful process.

Ultimately, the future of PMCF envisions a more seamless, integrated, and intelligent surveillance ecosystem. This involves not only leveraging advanced technologies but also fostering greater collaboration across stakeholders – manufacturers, healthcare providers, patients, and regulatory bodies. The goal is to move towards a system where post-market surveillance is less about retrospective reporting and more about real-time insights, predictive analytics, and proactive risk mitigation. This digital transformation of PMCF promises to enhance patient safety, accelerate product innovation, and create a more resilient and responsive medical device industry globally, truly embodying a lifecycle approach to device management.

8.1 The Role of Artificial Intelligence and Machine Learning in PMCF

Artificial Intelligence (AI) and Machine Learning (ML) are set to revolutionize PMCF by transforming how data is analyzed, patterns are identified, and risks are predicted. Traditional PMCF often relies on manual review and statistical analysis of structured data, which can be time-consuming and may miss subtle signals in vast, complex datasets. AI/ML algorithms, conversely, excel at processing large volumes of heterogeneous data, including unstructured text from electronic health records or physician notes, to identify correlations and anomalies that human analysts might overlook.

For instance, ML models can be trained to automatically sift through millions of adverse event reports, patient complaints, and social media discussions to detect early trends or clusters of issues related to a specific device, long before they become statistically significant through conventional methods. Predictive analytics, powered by AI, can forecast potential device failures or patient subgroups at higher risk of adverse events based on demographic, clinical, and device usage patterns, enabling proactive interventions. Furthermore, natural language processing (NLP) can extract crucial information from free-text fields in clinical notes or user feedback, converting qualitative data into quantifiable insights. This intelligent analysis capability dramatically enhances the efficiency and effectiveness of PMCF, allowing manufacturers to move from reactive detection to proactive prediction and prevention of safety and performance issues, thereby significantly strengthening patient protection and informing faster, more targeted product improvements.

8.2 Leveraging Digital Health Technologies and Connected Devices

The proliferation of digital health technologies, including wearable sensors, connected medical devices, and mobile health applications, offers unprecedented opportunities for real-time, continuous PMCF data collection. These technologies are capable of passively and actively gathering a rich tapestry of real-world data directly from patients in their daily lives, providing insights into device performance, user adherence, and patient-reported outcomes that were previously impossible to obtain.

For example, a connected insulin pump can automatically log dosage history, glucose readings, and alarm events, providing a continuous stream of data on device usage patterns and patient glycemic control. A smart inhaler can track medication adherence and environmental triggers for asthma attacks, offering valuable insights into the device’s real-world effectiveness. This direct-to-patient data collection enhances the granularity and ecological validity of PMCF, moving beyond episodic clinical visits. However, leveraging these technologies for PMCF necessitates robust data governance frameworks, stringent cybersecurity protocols to protect sensitive patient information, and ethical considerations for informed consent. The challenge lies not just in collecting the data but in effectively integrating, standardizing, and analyzing these massive, continuous data streams to derive actionable insights, making the seamless integration of these technologies into PMCF strategies a key area of future development for manufacturers.

8.3 Towards a More Integrated and Proactive Global Surveillance System

The future of PMCF is trending towards a more integrated and proactive global surveillance system that transcends national borders and individual device types. Regulatory authorities worldwide are increasingly collaborating and harmonizing their approaches to post-market oversight, recognizing that device safety is a global concern. This push towards harmonization aims to create a more efficient and effective system for identifying and responding to safety signals, preventing widespread adverse events, and facilitating the timely dissemination of critical safety information.

Key aspects of this evolution include the development of international standards for data collection and reporting, enhanced data sharing mechanisms between regulatory bodies, and the greater utilization of common device identification systems like the Unique Device Identification (UDI) system. This global perspective encourages manufacturers to build PMCF systems that are not just compliant with a single jurisdiction but are robust enough to meet the highest international standards, allowing for more streamlined global market access and a more comprehensive understanding of their devices’ performance across diverse populations and healthcare systems. The ultimate goal is to move from a fragmented, reactive approach to a truly integrated, proactive, and predictive global surveillance framework, where continuous clinical follow-up is a shared responsibility, continuously learning from real-world data to ensure the highest levels of patient safety and drive innovation across the medical device industry.

9. Conclusion: Embracing PMCF for Sustainable Medical Device Excellence

Post-Market Clinical Follow-up (PMCF) has unequivocally emerged as a cornerstone of medical device regulation, particularly under the demanding framework of the EU MDR. Far from being a mere regulatory burden, PMCF is an indispensable, systematic, and continuous process that mandates manufacturers to actively monitor the safety and performance of their devices throughout their entire lifecycle. It represents a fundamental shift from a transactional, pre-market approval mindset to a sustained commitment to patient safety and product integrity in the dynamic real-world clinical environment. Embracing a robust PMCF strategy is no longer optional; it is a critical differentiator for manufacturers dedicated to achieving and maintaining excellence in the global medical device market.

The journey through PMCF demands meticulous planning, effective resource allocation, and a deep understanding of diverse methodologies, ranging from proactive clinical investigations and registries to the judicious collection and analysis of reactive real-world data and user feedback. Challenges such as data harmonization, resource constraints, and navigating evolving regulatory expectations are significant, yet surmountable with strategic foresight and investment in appropriate expertise and technologies. Manufacturers who proactively address these hurdles, integrate PMCF seamlessly into their quality and risk management systems, and leverage the power of digital transformation, including AI/ML and connected devices, will not only ensure compliance but also unlock substantial strategic advantages that propel their businesses forward.

Ultimately, a commitment to comprehensive PMCF transcends regulatory checkboxes; it fosters a culture of continuous improvement, drives product innovation, enhances market confidence, and facilitates global market access. The insights gained from ongoing clinical follow-up directly inform product enhancements, optimize patient outcomes, and strengthen the credibility of manufacturers as responsible custodians of healthcare technology. As the regulatory landscape continues to evolve and technologies advance, embracing PMCF not just as a requirement, but as a core tenet of sustainable medical device excellence, will be paramount for securing a competitive edge and consistently delivering safe, effective, and innovative solutions that genuinely improve patients’ lives worldwide.

Leave a Comment

Your email address will not be published. Required fields are marked *

error: Content is protected !!