NDT PERFORMANCE DEMONSTRATION USING SIMULATION N. Dominguez, F. Jenson, CEA P. Dubois, F. Foucher, EXTENDE nicolas.dominguez@cea.fr CEA 10 AVRIL 2012 PAGE 1
NDT PERFORMANCE DEMO. USING SIMULATION OVERVIEW Why using simulation for NDT performance demonstration NDT performance demonstration approaches Examples & tools for NDT performance demonstration Challenges CEA 10 AVRIL 2012 PAGE 2
NDT PERFORMANCE DEMO. USING SIMULATION OVERVIEW Why using simulation for NDT performance demonstration NDT performance demonstration approaches Examples & tools for NDT performance demonstration Challenges CEA 10 AVRIL 2012 PAGE 3
WHY USING SIMULATION FOR NDT PERFORMANCE THINK NDT BEFORE IT S TOO LATE Prepare NDT before parts are manufactured Possible use of digital mock-ups Evaluate changes of material, geometry Early feed-back to design teams CEA 10 AVRIL 2012 PAGE 4
WHY USING SIMULATION FOR NDT PERFORMANCE ANTICIPATE NEEDS NDT often comes late in manufacturing processes. When parts arrive it is often too late to launch R&D or investments. => Early performance evaluation can help. Complex geometry inspection Composite parts inspection Phased array solution CEA 10 AVRIL 2012 PAGE 5
WHY USING SIMULATION FOR NDT PERFORMANCE UNDERSTAND NDT PROCESS BEHAVIOUR Propagation behaviour CEA 10 AVRIL 2012 PAGE 6
WHY USING SIMULATION FOR NDT PERFORMANCE REDUCE COSTS Samples Coupons = $, CEA 10 AVRIL 2012 PAGE 7
NDT PERFORMANCE DEMO. USING SIMULATION OVERVIEW Why using simulation for NDT performance demonstration NDT performance demonstration approaches Examples & tools for NDT performance demonstration Challenges CEA 10 AVRIL 2012 PAGE 8
NDT PERFORMANCE DEMONSTRATION DEMONSTRATIONS OF PERFORMANCES NUCLEAR QUALIFICATION RSEM97 Comprehensive NDT Deterministic proof: worst case PROBABILITY OF DETECTION (POD) Intensive NDT Statistical analysis CEA 10 AVRIL 2012 PAGE 9
NDT PERFORMANCE DEMONSTRATION NUCLEAR QUALIFICATION (France RSEM97) EDF philosophy (ENIQ based) Demonstrate the ability for a process to detect and/or characterize flaws of a given size in a given component taking into account environment. Comprehensive study Includes worst case Every defect must be detected CEA 10 AVRIL 2012 PAGE 10
NDT PERFORMANCE DEMONSTRATION PROBABILITY OF DETECTION (POD) Damage tolerance design rules impose production of POD values as input for maintenance interval justification Quantify the ability of a process, implemented in operational conditions, to detect flaws of different sizes. Intensive NDT Statistical analysis Defects are detected with a given POD and given confidence CEA 10 AVRIL 2012 PAGE 11
NDT PERFORMANCE DEMONSTRATION ANALYSIS OF PARAMETERS VARIABILITY ON NDT RESULT List influent parameters (explicitly) nominal value range of variation [min; max] For each parameter, quantify influence on inspection result and demonstrate that the targeted defects are still detected. Deterministic approach Realize NDT according to the procedure under evaluation: Influent parameters are integrated implicitly. Global analysis of influence of parameters by statistical estimation. Probabilistic approach CEA 10 AVRIL 2012 PAGE 12
NDT PERFORMANCE DEMONSTRATION OUTPUT OF NDT PERFORMANCE DEMONSTRATION The NDT procedure allows sure detection of flaws of size a within the specified range of application. The NDT procedure allows detection of flaws of size a with a probability p. 100 The probability of missing a defect is not considered. Probability Of Detection (%) 90 80 70 60 50 40 30 20 10 0 0 0.5 1 1.5 2 2.5 Crack length (mm) Estimated POD POD 95% confidence Empirical POD CEA 10 AVRIL 2012 PAGE 13
NDT PERFORMANCE DEMONSTRATION NUCLEAR & AERONAUTICS: WHAT IN COMMON? Both approach Require production of a large number of data (samples and NDT) Include sources of variability in the NDT results (implicitly or explicitly) Simulation can help in producing data for NDT performance demonstration CEA 10 AVRIL 2012 PAGE 14
NDT PERFORMANCE DEMO. USING SIMULATION OVERVIEW Why using simulation for NDT performance demonstration NDT performance demonstration approaches Examples & tools for NDT performance demonstration Challenges CEA 10 AVRIL 2012 PAGE 15
EXAMPLE OF PERFORMANCE DEMONSTRATION DETERMINISTIC ANALYSIS Example: UT of Thermal Sleeve of Steam Generator Bring elements for Technical Justification in Qualification Dossier Reduce the number of mock-ups or their complexity CEA 10 AVRIL 2012 PAGE 16
EXAMPLE OF PERFORMANCE DEMONSTRATION DETERMINISTIC ANALYSIS Example: UT of Thermal Sleeve of Steam Generator What is the response if the defect takes different positions around the sleeve? θ 0 Some positions can be studied with a mock-up, But the variation will not be linear How choosing positions? CEA 10 AVRIL 2012 PAGE 17
EXAMPLE OF PERFORMANCE DEMONSTRATION DETERMINISTIC ANALYSIS Example: UT of Thermal Sleeve of Steam Generator What is the response if the defect takes different positions around the sleeve? CEA 10 AVRIL 2012 PAGE 18
EXAMPLE OF PERFORMANCE DEMONSTRATION DETERMINISTIC ANALYSIS Example: UT of Thermal Sleeve of Steam Generator What is the response if the defect takes different positions around the sleeve? => Make one mock-up with 2 defects at different positions and get the experimental amplitudes Experimental data Then what is amplitude for other positions? Guess? Other mock-ups? Or Amplitude (db) 0,0-10,0-20,0-30,0-40,0-50,0-60,0 Experience -70,0-40 -20 0 20 40 60 80 100 Defect angular position( ) CEA 10 AVRIL 2012 PAGE 19
EXAMPLE OF PERFORMANCE DEMONSTRATION DETERMINISTIC ANALYSIS Example: UT of Thermal Sleeve of Steam Generator What is the response if the defect takes different positions around the sleeve? => Complete the data set by using simulation! Experimental data 4dB -15dB 3dB -14dB 8dB -5dB 12dB -11dB 21dB 29dB θ θ = = 40 70 θ = 50 30 θ 20 =0 θ = θ 60 = -20 θ = -10 θ =10 Amplitude (db) 0,0-10,0-20,0-30,0-40,0-50,0 Threshold: -38 db 0dB -60,0 Simulation Experience -70,0-40 -20 0 20 40 60 80 100 Defect angular position( ) CEA 10 AVRIL 2012 PAGE 20
EX. & TOOLS FOR PERFORMANCE DEMONSTRATION VARIATION SCENARIOS Tools to achieve deterministic variation analysis 1. List influent parameters and give a range of variation [min;max] 2. Compute NDT response for each combination of parameters 3. Draw resulting curves CEA 10 AVRIL 2012 PAGE 21
4 3.5 3 2.5 2 1.5 1 0.5 0.015 0.01 0.005 0 0 10 20 30 40 50 60 70 80 90 100 Lift-off (µm) 0 0.1 0.2 0.3 0. 4 0.5 0.6 0. 7 0.8 0.9 Crack height (ratio of length) 1.2 1 0.8 0.6 0.4 0.2 0-1 -0.5 0 0.5 1 Conductivity variation (MS/m) 1 0.8 0.6 0.4 0.2 0-1 -0.8-0.6-0. 4-0.2 0 0.2 0.4 0.6 0.8 1 Y start position (mm) EX. & TOOLS FOR PERFORMANCE DEMONSTRATION POD ANALYSIS Apply specific variation scenario to produce POD curves Input parameters: Part Dimensions Conductivity Probe Dimensions Number of turns Frequency Inspection Start scan position Scan increment Lift-off Flaw Shape Length Height Width Probability density Probability density Probability density Probability density Signal response (%FSH) POD (%) 100 80 60 40 20 0 0 0.5 1 1.5 2 2.5 3 3.5 4 4.5 5 100 90 80 70 60 50 40 30 20 10 Crack length (mm) With uncertainties Deterministic 0 0 0.5 1 1.5 2 2.5 3 3.5 Crack length (mm) Estimated POD (simulation with uncertainties) POD 95% confidence (simulation with uncertainties) Step detection function (no uncertainty) Explicit influent parameters description needed for POD using simulation CEA 10 AVRIL 2012 PAGE 22
TOOLS FOR PERFORMANCE DEMONSTRATION POD simulation by uncertainties propagation 0.4 Probability density 0.35 0.3 0.25 0.2 0.15 0.1 Input parameter values are picked up «randomly» following the probability density function 0.05 0-4 -3-2 -1 0 1 2 3 4 Probe angle ( ) Input: uncertainty Output: variability S Y * * * * CEA 10 AVRIL 2012 PAGE 23 a
POD EVALUATION USING SIMULATION AUTOMATED PHASED ARRAY INSPECTION OF ELECTRON BEAM WELDING (STEEL) Part NDT Configuration: Phased array UT Multi-points focusing along the weld (0.2 mm pitch) 0.2 mm increment on external radius Material: Steel Electron Beam Welding Geometry: Locally flat areas Defects: Voids Probe: Linear array 32 elements, pitch 0.3 mm, 10 MHz central frequency Conditions: In-plant (automated rotation) CEA 10 AVRIL 2012 PAGE 24
TOOLS FOR PERFORMANCE DEMONSTRATION POD simulation: probabilistic variation scenario CEA 10 AVRIL 2012 PAGE 25
TOOLS FOR PERFORMANCE DEMONSTRATION POD Analysis CEA 10 AVRIL 2012 PAGE 26
NDT PERFORMANCE DEMO. USING SIMULATION OVERVIEW Why using simulation for NDT performance demonstration NDT performance demonstration approaches Examples & tools for NDT performance demonstration Challenges CEA 10 AVRIL 2012 PAGE 27
CHALLENGES IN PERFORMANCE DEMONSTRATION ZONE COVERAGE FOR COMPLEX PARTS How to ensure zone coverage of areas to be inspected, with a specified sensitivity? POD WITH CONFIDENCE How to provide simulated POD with confidence? CEA 10 AVRIL 2012 PAGE 28
TOOLS FOR PERFORMANCE DEMONSTRATION ZONE COVERAGE (SENSITIVITY) Context: Inspection of a part with a complex geometry Objective: For a given zone, ensure that the probe allows detection of a given defect located somewhere in the zone. Simulation can help, providing tools to Define the appropriate probe trajectory Determine the appropriate delay laws associated to the computed trajectory Evaluate the sensitivity of the inspection everywhere in the inspected zone CEA 10 AVRIL 2012 PAGE 29
ZONE COVERAGE (SENSITIVITY) First step: Definition of the zone to be inspected and defect type to be detected Computation of optimal probe positions and corresponding optimal delay laws
ZONE COVERAGE (SENSITIVITY) Second step: Determination of the appropriate probe trajectory The cloud formed by the optimal probe positions may be difficult to describe with a parametric trajectory (such as those used by a robot for instance) Necessary to simplify the problem
ZONE COVERAGE (SENSITIVITY) Third step: Computation of sensitivity maps Using the cloud of optimal probe positions After simplification, using a parametric probe trajectory Further works: Propose GUI for the 3 step process Sensitivity maps in 3D views, projected onto the specimen
CHALLENGES IN PERFORMANCE DEMONSTRATION CONFIDENCE IN POD ESTIMATION WITH SIMULATION Difficult point: fill in the uncertain parameters description in input? What influence on POD result? CEA 10 AVRIL 2012 PAGE 33
CHALLENGES IN PERFORMANCE DEMONSTRATION POD POD study POD scenario study CONFIDENCE IN POD ESTIMATION WITH SIMULATION One POD scenario is: 1. Define uncertain parameters 2. Calculate POD curve Scan Crack Probe position Scan height Crack angle Probe position Uniform Gaussian height Gaussian angle Min Max µ σ µ σ 1-0.5 0.5 0.5L 0.13 0.12 L 2-0.5 0.5 0.5L 0.09 L Sure 3-0.5 0.5 0.5L 0.11 L 0 1.6 1.0 0 0.9 Not 0 0.5 sure k -0.5 0.5 0.5L 0.17 L 0 1.2 k POD curves Confidence approach: calculate a beam of scenarios and use the scattering on the POD curves to estimate a confidence CEA 10 AVRIL 2012 PAGE 34
CHALLENGES IN PERFORMANCE DEMONSTRATION CONFIDENCE IN POD ESTIMATION WITH SIMULATION CERTAINTY INDEX DEFINITION Applies on the probability distribution parameters Index 5 No uncertainty on the distribution parameter Index 4 The distribution parameter follows a gaussian law with (µ=gv*, σ=20% GV) Index 3 The distribution parameter follows a gaussian law with (µ=gv, σ=50% GV) Index 2 The distribution parameter follows a gaussian law with (µ=gv, σ=100% GV) Index 1 The distribution parameter follows a uniform law with (min=gv-3*gv, max=gv+3gv) Sure Almost sure Rather sure Not so sure Not sure at all * GV stands for «guessed value» CEA 10 AVRIL 2012 PAGE 35
CHALLENGES IN PERFORMANCE DEMONSTRATION CONFIDENCE IN POD ESTIMATION WITH SIMULATION The 95% lower confidence POD curve is the curve which leaves on the left 95% of the «POD curves» of the beam. In practice the POD curve with confidence can be built pointwize, looping on POD values : For p in [0.01;0.99] Find the POD curve leaving 95 % of the curves on the left at ordinate p Pick-up the corresponding flaw size a p End The POD curve with confidence is the set of points (a p, p). CEA 10 AVRIL 2012 PAGE 36
CHALLENGES IN PERFORMANCE DEMONSTRATION CONFIDENCE IN POD ESTIMATION WITH SIMULATION Automated Phased Array UT of EBWeld Manual HFET of fatigue cracks on Ti a 90/95 = 0.26 mm a 90/95 = 1.51 mm The more the NDT process is mastered and repeatable, the better the confidence. CEA 10 AVRIL 2012 PAGE 37
TOOLS FOR PERFORMANCE DEMONSTRATION SUMMARY Simulation can help in making performance demonstrations Variation tools allow for deterministic performance analysis Probabilistic variation tools allow for POD evaluation Zone coverage tools allows design of NDT including a target of sensitivity CEA 10 AVRIL 2012 PAGE 38
TOOLS FOR PERFORMANCE DEMONSTRATION Visit our new website: www-civa.cea.fr CEA 10 AVRIL 2012 PAGE 39