Ignite Creation Date:
2025-12-24 @ 10:50 PM
Ignite Modification Date:
2025-12-25 @ 8:19 PM
Study NCT ID:
NCT06175169
Status:
RECRUITING
Last Update Posted:
2023-12-18
First Post:
2023-11-30
Is NOT Gene Therapy:
False
Has Adverse Events:
False
Brief Title:
IA Model for Acute Appendicitis in CT
Sponsor:
Organization:
Raw JSON
{'hasResults': False, 'derivedSection': {'miscInfoModule': {'versionHolder': '2025-12-24'}, 'conditionBrowseModule': {'meshes': [{'id': 'D001064', 'term': 'Appendicitis'}], 'ancestors': [{'id': 'D059413', 'term': 'Intraabdominal Infections'}, {'id': 'D007239', 'term': 'Infections'}, {'id': 'D005759', 'term': 'Gastroenteritis'}, {'id': 'D005767', 'term': 'Gastrointestinal Diseases'}, {'id': 'D004066', 'term': 'Digestive System Diseases'}, {'id': 'D002429', 'term': 'Cecal Diseases'}, {'id': 'D007410', 'term': 'Intestinal Diseases'}]}, 'interventionBrowseModule': {'meshes': [{'id': 'D008954', 'term': 'Models, Biological'}], 'ancestors': [{'id': 'D008962', 'term': 'Models, Theoretical'}, {'id': 'D008919', 'term': 'Investigative Techniques'}]}}, 'protocolSection': {'designModule': {'phases': ['NA'], 'studyType': 'INTERVENTIONAL', 'designInfo': {'allocation': 'RANDOMIZED', 'maskingInfo': {'masking': 'SINGLE', 'whoMasked': ['PARTICIPANT'], 'maskingDescription': 'All image data were anonymized with the deletion of Dicom header information such as sex, age, and CT protocol. Participants were given CT slices that were identical to the range of the VOI for appendicitis generated automatically through the extraction pipeline of the IA model. A total of 20 axial CT slice images of a 5-mm cut were masked with blinded truth labeling and a blackened background on the outside of the body surface.'}, 'primaryPurpose': 'DIAGNOSTIC', 'interventionModel': 'PARALLEL', 'interventionModelDescription': 'A deep learning model, "Information of Appendix (IA)," based on a fully automated 3D convolutional neural network using transfer learning, has been developed to diagnose appendicitis in an abdominopelvic CT scan. The IA model was trained, validated, and tested on 3D-DenseNet, 3D-EfficientNet, and 3D-ResNet. External validation was completed through the data exfiltration of external institutions. The IA model yielded the probability of three classifications: non-appendicitis, simple appendicitis, and complicated appendicitis for patients who presented to the emergency room with abdominal pain and underwent abdominopelvic CT for suspected acute appendicitis.\n\nIn this study, we confirmed that the intervention did not affect the included patients. Considering the minimal risk to human subjects and the ethical and legal aspects of artificial intelligence, we excluded the involvement of the IA model in all treatment processes.'}, 'enrollmentInfo': {'type': 'ESTIMATED', 'count': 568}}, 'statusModule': {'overallStatus': 'RECRUITING', 'startDateStruct': {'date': '2023-07-04', 'type': 'ACTUAL'}, 'expandedAccessInfo': {'hasExpandedAccess': False}, 'statusVerifiedDate': '2023-12', 'completionDateStruct': {'date': '2025-12-31', 'type': 'ESTIMATED'}, 'lastUpdateSubmitDate': '2023-12-08', 'studyFirstSubmitDate': '2023-11-30', 'studyFirstSubmitQcDate': '2023-12-08', 'lastUpdatePostDateStruct': {'date': '2023-12-18', 'type': 'ACTUAL'}, 'studyFirstPostDateStruct': {'date': '2023-12-18', 'type': 'ACTUAL'}, 'primaryCompletionDateStruct': {'date': '2024-12-31', 'type': 'ESTIMATED'}}, 'outcomesModule': {'primaryOutcomes': [{'measure': 'Negative appendectomy rate', 'timeFrame': 'Outcome measurement for four test items of non-radiologists will be assessed for an average of one year through study completion.', 'description': 'Description: False positive rate = FP /FP +TN FP: false positive, TN true negative Assessment of outcomes: To evaluate diagnostic performance in humans, four test items for non-radiologists were set up as follows: (1) Appendix visualization: Can you find the location of the appendix? ① Yes ② No (2) Exclusion of appendicitis: Can appendicitis be excluded from the CT images? ① Yes (non-appendicitis) ② No (simple or complicated appendicitis) (3) If your choice is "no (simple or complicated appendicitis)," is appendicitis accompanied by complication? ① Yes (complicated appendicitis) ② No (simple appendicitis) (4) Finally, what is the radiologic diagnosis based on CT images in patients presenting with acute right or lower abdominal pain in the ER? ① Non-appendicitis ② simple appendicitis ③ complicated appendicitis The NAR was calculated as the primary endpoint using the outcomes of (2) the answer sheet of the non-radiologist and the Stage 1 IA model-yielding class.'}]}, 'oversightModule': {'oversightHasDmc': True, 'isFdaRegulatedDrug': False, 'isFdaRegulatedDevice': False}, 'conditionsModule': {'keywords': ['deep learning'], 'conditions': ['Acute Appendicitis']}, 'referencesModule': {'seeAlsoLinks': [{'url': 'http://mach.hallym.or.kr/', 'label': 'Medical A.I. Center of Hallym University'}]}, 'descriptionModule': {'briefSummary': "the investigators's study group has developed a fully automated 3D convolutional neural network (CNN)-based diagnostic framework using information of appendix (IA) model to identify non-appendicitis and simple and complicated appendicitis on CT scan images based on the two-stage binary classification algorithm, as a clinician does for deciding treatment. The dataset was built from a large population of patients visiting emergency departments who underwent intravenous contrast-enhanced abdominopelvic CT examinations to evaluate abdominal pain in the right or lower quadrant area as the chief complaint. Recently, the IA model was externally validated using a dataset of multicenter institutions through data exfiltration. In this study, the investigators hypothesized that the IA model would show a comparable negative appendicitis rate of \\<10% non-inferior margins compared to non-radiologists with a shorter interpretation time in a prospectively randomized dataset.", 'detailedDescription': 'Development of information of appendix model\n\n\\- This study used a pretrained information of appendix (IA) model based on a fully automated diagnostic framework to predict three classes with probability and feature mapping: non-appendicitis, simple appendicitis, and complicated appendicitis.\n\nThe pipeline of IA model embedding parameters learned from the 3D CT image of 7,147 patients consisted of a two-stage binary algorithm connected to transfer learning with three 3D CNN models: DenseNet, EfficientNet, and ResNet.\n\n\\- A two-stage binary algorithm for transfer learning was applied to learn inherent patterns from the 3D images of three true classes, as way a clinician does when deciding treatment for appendicitis. In the first step of the pipeline, a Stage 1 classification model was developed to identify non-appendicitis vs. appendicitis. In the second step of the pipeline, the Stage 2 classification model identified simple vs. complicated appendicitis from the data transferred with the trainable parameters learned in Stage 1.\n\nCurrently, the final IA model has been externally validated using a never-before-seen dataset from an outside institution with broad eligibility criteria for patients who visited the emergency room with abdominal pain and underwent abdominopelvic CT due to clinical suspicion of acute appendicitis.\n\nIntervention This is a comparative study between human and IA models for the negative appendectomy rate (NAR) in non-, simple, and complicated appendicitis of a prospective randomized dataset, which was collected from CT scans of patients who visited the emergency room with acute abdominal pain. The participants in the control arm were ten non-radiologists.\n\nThe IA model is not allowed to impede the preoperative decision process of clinicians in ongoing clinical practice regarding the legal and ethical aspects of interrogating the diagnostic frameworks of the IA model on the mathematical reasoning for an outcome in terms of protecting human subjects.\n\nConsidering the minimal risk to human subjects and the ethical and legal aspects of artificial intelligence, the study design strictly allocates CT images to non-radiologists and IA models after completion of treatment for appendicitis with or without pathologic confirmation.\n\nData allocation and performance evaluation\n\n\\- To compare the IA model to humans and non-radiologists equally, the interpretation condition for a non-radiologist should meet all criteria as follows: Only CT images without such variables as age, sex, and laboratory values should be randomly assigned; affiliation of both the non-radiologist and patient of the CT image should not be the same; the allocation ratio for non-appendicitis, simple, and complicated appendicitis assigned to the non-radiologist should be blinded; and the range of the CT image for interpretation should be identical to the range of the ROI for the appendix, which is generated by automatic localization of the IA model. To evaluate the diagnostic performance in humans, four test items were set up by a non-radiologist as follows: (1) visualization of the appendix; (2) exclusion of appendicitis; (3) complications; and (4) diagnosis of CT images.\n\nThe primary and secondary outcomes were assessed using the results of the four questions for the participants and the diagnostic performance of the IA model in the same dataset.\n\nEthical statement According to the "Guide to Utilizing Healthcare Data" and "Guide to Handling Pseudonym Information" of the Personal Information Protection Commission of the Ministry of Health and Welfare, data exfiltration with security assurance of the data archive was conducted with the approval of the Data Review Board at participating institutions. The central institutional review board (IRB) and IRBs of all participating institutions approved this study.\n\nSample size and statistical methods The investigators\'s prior study, which completed external validation of the IA model through data exfiltration of external institutions, showed an NAR of 12.4% in the external dataset. The standard reference value for non-radiologists for NAR has been reported as 10.5% ± 5%. Therefore, the acceptable difference in NAR between the IA model and non-radiologists for clinical application should be less than 10.0% of the non-inferiority margin.\n\nThe sample size for the randomized controlled dataset for a single institution was 263 assuming a 95% confidence interval, statistical power of 90%, two-tails sided α = 0.05, significance level = 0.05, and effect size = 0.2 at the Z-test. Two external institutions participated in this study. Due to data heterogeneity, normalization, and prevalence differences across regions between the two external institutions, the sample size was calculated for each institution. Therefore, assuming 263 patients per institution with a follow-up loss of 10%, the total sample size was 568.'}, 'eligibilityModule': {'sex': 'ALL', 'stdAges': ['CHILD', 'ADULT', 'OLDER_ADULT'], 'minimumAge': '12 Years', 'healthyVolunteers': False, 'eligibilityCriteria': "Inclusion Criteria:\n\nInclusion criteria for broad eligibility were applied to reflect that the CT utilization rate in the emergency room has rapidly expanded, presumably in many other institutions where physicians maintain a reasonably sensitive standpoint in raising a clinical suspicion of appendicitis as a cause of abdominal pain and then use CT as an imaging test to confirm or rule out appendicitis.\n\nWhen the imaging protocol parameters were as follows: abdomen or pelvis (intravenous contrast, 2 mg/kg, maximum 160 mL), scan timing (portal venous phase), range (from 4 cm above the liver dome to 1 cm below the ischial tuberosity), radiation dose (tube potential, KVP from 100 to 120), pitch 1.75:1, and reconstruction (5 mm, cut slice for adults; 3 mm, cut slice for children under 12 years old), anonymized CT images of patients were referred to a randomized dataset.\n\nExclusion Criteria:\n\nPatients who did not fulfill the CT imaging protocol were excluded in detail as follows:\n\ni) Failure to meet the CT protocol criteria of this study: liver CT, biliary CT, etc. (if contrast phase was different); ureter CT, etc. (if contrast media was not used and the reconstruction method was different); non-enhanced CT (when contrast media was not used); and appendix CT or low-dose CT (when radiation dose was low).\n\nii) When the quality of the CT image is significantly reduced, as follows: when blurring occurs (motion artifact) or metal artifact (when internal fixation is performed due to spinal surgery).\n\niii) when it was evident from the medical record review that clinical information suggested that APCT was performed due to the suspicion of a condition other than appendicitis, as follows: suspected acute cholecystitis due to RUQ tenderness and Murphy's sign; suspected urolithiasis due to flank pain and gross hematuria; suspected pancreatitis due to a history of pancreatitis; alcohol abuse; and suspected gynecological diseases due to vaginal discharge. Suspected panperitonitis due to whole abdominal tenderness, rebound tenderness, and unstable vital signs. Patients with acute cholecystitis, ureteral stones, pancreatitis, or acute peritonitis due to small bowel or colon perforation were also excluded.\n\niv) Patients younger than 10 years were excluded. Adolescent patients from 11 to 18 years old were included in the study if the exclusion criteria were not applicable.\n\nv) diagnosed by ultrasound sonography vi) Patients who were transferred to the emergency department after a diagnosis of appendicitis at an outside hospital or ambulatory care were excluded.\n\nvii) Patients with appendicitis who did not undergo surgical treatment because of the enrollment protocol of other ongoing studies.\n\nviii) patients who had undergone an appendectomy"}, 'identificationModule': {'nctId': 'NCT06175169', 'briefTitle': 'IA Model for Acute Appendicitis in CT', 'organization': {'class': 'OTHER', 'fullName': 'Hallym University Medical Center'}, 'officialTitle': 'Prospective Randomized Control Study for Exclusion of Negative Appendicitis; Deep Learning Model, Information of Appendix (IA) Versus Non-radiologists', 'orgStudyIdInfo': {'id': 'Project MHo4'}}, 'armsInterventionsModule': {'armGroups': [{'type': 'ACTIVE_COMPARATOR', 'label': 'IA model', 'description': 'A fully automated diagnostic framework based on 3D-CNN model to predict non-appendicitis, simple and complicated appendicitis', 'interventionNames': ['Device: Information of Appendix (IA) model']}, {'type': 'NO_INTERVENTION', 'label': 'Non-radiologist', 'description': 'Ten non-radiologists participated in this study. CT image same to IA model was allocated to radiologist randomly.'}], 'interventions': [{'name': 'Information of Appendix (IA) model', 'type': 'DEVICE', 'description': 'Deep learning model', 'armGroupLabels': ['IA model']}]}, 'contactsLocationsModule': {'locations': [{'zip': '14068', 'city': 'Anyang-si', 'state': 'Gyeonggi-do', 'status': 'RECRUITING', 'country': 'South Korea', 'facility': 'Hallym University Medical Center', 'geoPoint': {'lat': 37.3925, 'lon': 126.92694}}], 'centralContacts': [{'name': 'Iltae Son', 'role': 'CONTACT', 'email': '1tae99@hanmail.net', 'phone': '+82-10-2373-4783'}, {'name': 'Minsung Kim', 'role': 'CONTACT', 'email': 'bongkay4@gmail.com', 'phone': '+82-10-2087-9792'}], 'overallOfficials': [{'name': 'Iltae Son', 'role': 'PRINCIPAL_INVESTIGATOR', 'affiliation': 'Hallym University Medical Center'}]}, 'ipdSharingStatementModule': {'ipdSharing': 'NO'}, 'sponsorCollaboratorsModule': {'leadSponsor': {'name': 'Hallym University Medical Center', 'class': 'OTHER'}, 'collaborators': [{'name': 'Doheon Institute for Digital Innovation In Medicine', 'class': 'UNKNOWN'}, {'name': 'Medical A.I. Center of Hallym University', 'class': 'UNKNOWN'}], 'responsibleParty': {'type': 'PRINCIPAL_INVESTIGATOR', 'investigatorTitle': 'Principal Investigator', 'investigatorFullName': 'Iltae Son', 'investigatorAffiliation': 'Hallym University Medical Center'}}}}