{ "_id": "6abb7f8199f7aa8c6aa44e85", "Package": "contentvalidR", "Type": "Package", "Title": "Tools for Substantive and Content Validity Pretesting", "Version": "0.10.1", "Authors@R": "c(\nperson(given = \"Joshua\", family = \"Uhalt\", email = \"Josh.Uhalt@gmail.com\",\nrole = c(\"aut\", \"cre\"))\n)", "Description": "Provides quantitative tools for substantive and\ncontent-oriented scale pretesting. Implements item-sort indices\nfrom Anderson and Gerbing (1991)\n, exact item-sort inference\nfollowing Howard and Melloy (2016)\n, empirical interpretation\nbenchmarks from Colquitt et al. (2019)\n, and the construct-rating procedure of\nHinkin and Tracey (1999) with\nHTC/HTD indices and repeated-measures item screening. The\nexpert-panel workflow combines Aiken's V with score confidence\nintervals, Lawshe content validity ratios with exact inference,\ncontent validity indices with modified kappa and score\nintervals, item-objective congruence, and panel-level agreement\nusing Krippendorff's alpha as described by Hayes and\nKrippendorff (2007) . Also\nprovides judge and rater heterogeneity analysis following the\ngeneralizability-theory treatment of content-validity ratings\nin Crocker, Llabre and Miller (1988)\n, content-domain\ncoverage and expert-perceived content structure following\nSireci and Geisinger (1992) ,\nconsensus and stability across Delphi rounds with between-round\nweighted kappa following Holey et al. (2007)\n, comparison across successive\npretest rounds, and exact expert-panel planning. Where\npublished methods compete, users choose among them through\narguments with evidence-based defaults. User-facing workflows\nemphasize interpretable summaries and transparent review\nrecommendations rather than isolated coefficients.", "License": "GPL-3", "Encoding": "UTF-8", "Language": "en-US", "Roxygen": "list(markdown = TRUE)", "VignetteBuilder": "knitr", "Config/testthat/edition": "3", "URL": "https://github.com/JUhalt/contentvalidR,\nhttps://juhalt.github.io/contentvalidR/", "BugReports": "https://github.com/JUhalt/contentvalidR/issues", "Config/Needs/website": "r-lib/pkgdown", "Config/roxygen2/version": "8.1.0", "Repository": "https://juhalt.r-universe.dev", "Date/Publication": "2026-09-29 02:36:35 UTC", "RemoteUrl": "https://github.com/JUhalt/contentvalidR", "RemoteRef": "v0.10.1", "RemoteSha": "4c13be087f2b2fd0dc7179525265b25c9160f0e5", "NeedsCompilation": "no", "Packaged": { "Date": "2026-09-29 08:49:55 UTC", "User": "root" }, "Author": "Joshua Uhalt [aut, cre]", "Maintainer": "Joshua Uhalt ", "_user": "juhalt", "_type": "src", "_file": "contentvalidR_0.10.1.tar.gz", "_fileid": "https://r2.ropensci.org/9637794a205eb22c7bb21b50e3575e53f2ab6f8d68dad533a88797b0cd8b8c2d", "_filesize": 1986011, "_sha256": "9637794a205eb22c7bb21b50e3575e53f2ab6f8d68dad533a88797b0cd8b8c2d", "_expires": "2027-01-07T09:06:00.000Z", "_created": "2026-09-29T08:49:55.000Z", "_published": "2026-09-29T09:06:08.973Z", "_jobs": [ { "job": 109330002031, "time": 171, "config": "linux-devel-x86_64", "r": "4.7.0", "check": "OK", "artifact": "11022214157" }, { "job": 109330001958, "time": 153, "config": "linux-release-x86_64", "r": "4.6.1", "check": "OK", "artifact": "11022471197" }, { "job": 109330001818, "time": 103, "config": "macos-oldrel-arm64", "r": "4.5.3", "check": "OK", "artifact": "11022522445" }, { "job": 109330001859, "time": 154, "config": "macos-release-arm64", "r": "4.6.1", "check": "OK", "artifact": "11022867168" }, { "job": 109328887698, "time": 192, "config": "source", "r": "4.6.1", "check": "OK", "artifact": "11021369874" }, { "job": 109330001849, "time": 97, "config": "wasm-release", "r": "4.6.0", "check": "OK", "artifact": "11022515407" }, { "job": 109330002100, "time": 141, "config": "windows-devel-x86_64", "r": "4.7.0", "check": "OK", "artifact": "11022167813" }, { "job": 109330002184, "time": 131, "config": "windows-oldrel-x86_64", "r": "4.5.3", "check": "OK", "artifact": "11021438464" }, { "job": 109330002029, "time": 116, "config": "windows-release-x86_64", "r": "4.6.1", "check": "OK", "artifact": "11022227620" } ], "_host": "GitHub-Actions", "_buildurl": "https://github.com/r-universe/juhalt/actions/runs/36544891774", "_status": "success", "_upstream": "https://github.com/JUhalt/contentvalidR", "_commit": { "id": "4c13be087f2b2fd0dc7179525265b25c9160f0e5", "author": "JUhalt <125321701+JUhalt@users.noreply.github.com>", "committer": "GitHub ", "message": "Release contentvalidR 0.10.1 (#88)\n\nRelease contentvalidR 0.10.1\n\nA documentation release. It stamps the version, release notes, citation\nmetadata, README, and roadmap for 0.10.1, which puts the handoff on the\nfront page:\n- the README section \"The handoff to nomologR\", mirrored by nomologR's\n \"The handoff from contentvalidR\" (#85);\n- Krippendorff (2011) linked to the Annenberg School copy (#86);\n- the nomologR reader recorded as tested against 0.6.0 through 0.10.0 (#87).\n\nNo computed value changes: 25 analyses across every workflow return the\nsame values as v0.10.0, and no function, argument, or handoff field\nchanged. Released on GitHub and R-universe; CRAN keeps 0.4.0 until the\njoint 1.0.\n\nCo-Authored-By: Claude Opus 5.5 ", "time": 1790649395 }, "_maintainer": { "name": "Joshua Uhalt", "email": "josh.uhalt@gmail.com", "login": "juhalt", "description": "", "uuid": 125321701 }, "_distro": "resolute", "_registered": true, "_dependencies": [ { "package": "R", "version": ">= 4.0.0", "role": "Depends" }, { "package": "stats", "role": "Imports" }, { "package": "irr", "role": "Suggests" }, { "package": "knitr", "role": "Suggests" }, { "package": "rmarkdown", "role": "Suggests" }, { "package": "testthat", "version": ">= 3.0.0", "role": "Suggests" } ], "_owner": "juhalt", "_selfowned": true, "_usedby": 0, "_updates": [ { "week": "2026-36", "n": 12 }, { "week": "2026-37", "n": 5 }, { "week": "2026-38", "n": 24 }, { "week": "2026-39", "n": 25 }, { "week": "2026-40", "n": 8 } ], "_tags": [ { "name": "v0.1.0", "date": "2026-09-02" }, { "name": "v0.2.0", "date": "2026-09-14" }, { "name": "v0.3.0", "date": "2026-09-15" }, { "name": "v0.3.1", "date": "2026-09-15" }, { "name": "v0.4.0", "date": "2026-09-16" }, { "name": "v0.5.0", "date": "2026-09-20" }, { "name": "v0.6.0", "date": "2026-09-20" }, { "name": "v0.7.0", "date": "2026-09-23" }, { "name": "v0.8.0", "date": "2026-09-26" }, { "name": "v0.9.0", "date": "2026-09-27" }, { "name": "v0.10.0", "date": "2026-09-28" }, { "name": "v0.10.1", "date": "2026-09-29" } ], "_topics": [ "content-validity", "delphi", "expert-panel", "measurement", "psychology", "psychometrics", "research-methods", "scale-development", "substantive-validity" ], "_stars": 0, "_contributors": [ { "user": "juhalt", "count": 84, "uuid": 125321701 } ], "_userbio": { "uuid": 125321701, "type": "user", "name": "JUhalt", "followers": 1 }, "_downloads": { "count": 0, "source": "https://cranlogs.r-pkg.org/downloads/total/last-month/contentvalidR" }, "_devurl": "https://github.com/juhalt/contentvalidr", "_pkgdown": "https://juhalt.github.io/contentvalidR/", "_searchresults": 0, "_rbuild": "4.6.1", "_assets": [ "extra/citation.cff", "extra/citation.html", "extra/citation.json", "extra/citation.txt", "extra/contents.json", "extra/contentvalidR.html", "extra/manual.pdf", "extra/NEWS.html", "extra/NEWS.txt", "extra/readme.html", "extra/readme.md" ], "_cranurl": false, "_releases": [ { "version": "0.4.0", "date": "2026-09-28" } ], "_exports": [ "agreement_summary", "aikens_v", "anova_content", "colquitt_benchmarks", "compare_rounds", "compute_csv", "compute_psa", "content_evidence", "content_handoff", "content_report", "content_structure", "contentvalid_glossary", "csv_binom_test", "cvi", "cvr", "delphi_validity", "domain_validity", "expert_power", "expert_validity", "gtheory_content", "htc", "htd", "interpret_colquitt", "ioc", "judge_validity", "panel_agreement", "qfactor_content", "rating_validity", "reproducibility_phi", "signal_detection", "similarity_from_sort", "simulate_anova_power", "simulate_csv_power", "sort_power", "sort_validity" ], "_help": [ { "page": "agreement_summary", "title": "Agreement summary (deprecated)", "topics": [ "agreement_summary" ] }, { "page": "aikens_v", "title": "Aiken's V for expert content-relevance ratings", "topics": [ "aikens_v" ] }, { "page": "anova_content", "title": "Hinkin-Tracey ANOVA content test", "topics": [ "anova_content" ] }, { "page": "as.data.frame.contentvalid_workflow", "title": "Extract workflow results as a plain data frame", "topics": [ "as.data.frame.contentvalid_workflow" ] }, { "page": "colquitt_benchmarks", "title": "Colquitt et al. (2019) empirical content-validation benchmarks", "topics": [ "colquitt_benchmarks" ] }, { "page": "compare_rounds", "title": "Compare content-validity evidence across pretest rounds", "topics": [ "compare_rounds" ] }, { "page": "compute_csv", "title": "Substantive Validity Coefficient (Csv)", "topics": [ "compute_csv" ] }, { "page": "compute_psa", "title": "Proportion of Substantive Agreement (Psa)", "topics": [ "compute_psa" ] }, { "page": "content_evidence", "title": "Combine content evidence across review stages", "topics": [ "content_evidence" ] }, { "page": "content_handoff", "title": "Carry content-validity decisions into empirical validation", "topics": [ "content_handoff" ] }, { "page": "content_report", "title": "Build a manuscript-ready results table", "topics": [ "content_report" ] }, { "page": "content_structure", "title": "Item-similarity structure of a content domain", "topics": [ "content_structure" ] }, { "page": "contentvalid_glossary", "title": "Glossary of contentvalidR indices and status terms", "topics": [ "contentvalid_glossary" ] }, { "page": "csv_binom_test", "title": "Exact item-sort significance test", "topics": [ "csv_binom_test" ] }, { "page": "cvi", "title": "Content Validity Index (CVI)", "topics": [ "cvi" ] }, { "page": "cvr", "title": "Lawshe's Content Validity Ratio (CVR)", "topics": [ "cvr" ] }, { "page": "delphi_validity", "title": "Delphi consensus and stability across rounds", "topics": [ "delphi_validity" ] }, { "page": "domain_validity", "title": "Analyze content-domain coverage and structure", "topics": [ "domain_validity" ] }, { "page": "expert_power", "title": "Plan an expert panel against an explicit decision criterion", "topics": [ "expert_power" ] }, { "page": "expert_validity", "title": "Analyze expert-panel content-validity evidence", "topics": [ "expert_validity" ] }, { "page": "gtheory_content", "title": "Generalizability analysis of content-validity ratings", "topics": [ "gtheory_content" ] }, { "page": "htc", "title": "Hinkin-Tracey correspondence (HTC)", "topics": [ "htc" ] }, { "page": "htd", "title": "Hinkin-Tracey distinctiveness (HTD)", "topics": [ "htd" ] }, { "page": "interpret_colquitt", "title": "Interpret a statistic using Colquitt et al. (2019) norms", "topics": [ "interpret_colquitt" ] }, { "page": "ioc", "title": "Item-Objective Congruence (IOC)", "topics": [ "ioc" ] }, { "page": "judge_validity", "title": "Analyze judge and rater heterogeneity in content-validity ratings", "topics": [ "judge_validity" ] }, { "page": "panel_agreement", "title": "Panel-level agreement among expert raters", "topics": [ "panel_agreement" ] }, { "page": "plot.contentvalid_delphi", "title": "Plot a Delphi analysis", "topics": [ "plot.contentvalid_delphi" ] }, { "page": "plot.contentvalid_evidence", "title": "Plot content evidence across review stages", "topics": [ "plot.contentvalid_evidence" ] }, { "page": "plot.contentvalid_expert", "title": "Plot expert-panel content-validity results", "topics": [ "plot.contentvalid_expert" ] }, { "page": "plot.contentvalid_expert_power", "title": "Plot an expert-panel planning curve", "topics": [ "plot.contentvalid_expert_power" ] }, { "page": "plot.contentvalid_rating", "title": "Plot Hinkin-Tracey rating evidence", "topics": [ "plot.contentvalid_rating" ] }, { "page": "plot.contentvalid_sort", "title": "Plot item-sort evidence", "topics": [ "plot.contentvalid_sort" ] }, { "page": "plot.contentvalid_sort_power", "title": "Plot exact item-sort planning evidence", "topics": [ "plot.contentvalid_sort_power" ] }, { "page": "plot.contentvalid_structure", "title": "Plot an expert content map", "topics": [ "plot.contentvalid_structure" ] }, { "page": "qfactor_content", "title": "Q-factor helper for content adequacy (comparator)", "topics": [ "qfactor_content" ] }, { "page": "rating_validity", "title": "Analyze a Hinkin-Tracey construct-rating content-validity pretest", "topics": [ "rating_validity" ] }, { "page": "reproducibility_phi", "title": "Between-pretest reproducibility (phi) of binary decisions", "topics": [ "reproducibility_phi" ] }, { "page": "signal_detection", "title": "Signal-detection summary for binary retention decisions", "topics": [ "signal_detection" ] }, { "page": "similarity_from_sort", "title": "Derive item similarities from an item-sort task", "topics": [ "similarity_from_sort" ] }, { "page": "simulate_anova_power", "title": "Legacy independent-groups ANOVA power simulator", "topics": [ "simulate_anova_power" ] }, { "page": "simulate_csv_power", "title": "Legacy simulation of item-sort target-count power", "topics": [ "simulate_csv_power" ] }, { "page": "sort_power", "title": "Exact power for the item-sort target-count rule", "topics": [ "sort_power" ] }, { "page": "sort_validity", "title": "Analyze an item-sort content-validity pretest", "topics": [ "sort_validity" ] } ], "_readme": "https://github.com/JUhalt/contentvalidR/raw/v0.10.1/README.md", "_rundeps": [], "_vignettes": [ { "source": "construct-rating-validity.Rmd", "filename": "construct-rating-validity.html", "title": "Construct-Rating Content Validation: Hinkin-Tracey to Colquitt", "engine": "knitr::rmarkdown", "headings": [ "What the rating workflow asks", "Example data", "HTC: definitional correspondence", "HTD: definitional distinctiveness", "Repeated-measures item screening", "Recommended workflow", "Scale-level Colquitt norms", "Naive versus expert judges", "Missing ratings", "Plotting", "Reporting", "References" ], "created": "2026-08-31 17:36:45", "modified": "2026-09-27 12:20:08", "commits": 4 }, { "source": "delphi-rounds.Rmd", "filename": "delphi-rounds.html", "title": "Delphi Rounds: Consensus and Stability", "engine": "knitr::rmarkdown", "headings": [ "Two questions, not one", "Decide three things before the first round", "The data", "Fitting the workflow", "Reading consensus", "Reading stability", "Seeing the trends", "Why the default looks at individual experts", "Relevance evidence round by round", "Reporting", "Carrying a Delphi forward", "What this analysis does not establish", "References" ], "created": "2026-09-19 14:22:02", "modified": "2026-09-28 16:57:03", "commits": 7 }, { "source": "design-and-reporting.Rmd", "filename": "design-and-reporting.html", "title": "Design & Reporting Guide", "engine": "knitr::rmarkdown", "headings": [ "Choosing a method", "Sample-size planning", "Recommended reporting sequence", "Deterministic bundled examples", "Table templates", "Item sort", "Construct rating", "Expert relevance", "Diagnostics and later validation", "Planning how many judges to recruit", "Good practices", "References" ], "created": "2025-08-27 21:11:21", "modified": "2026-09-27 12:42:36", "commits": 6 }, { "source": "expert-panel-validity.Rmd", "filename": "expert-panel-validity.html", "title": "Expert-Panel Content Validation: Relevance, Essentiality, and Congruence", "engine": "knitr::rmarkdown", "headings": [ "Why expert-panel methods need separate modes", "Relevance: Aiken V, score intervals, and CVI", "Panel-level agreement", "Why alpha can be low when experts agree", "Gwet's AC1", "The interval", "Essentiality: Lawshe CVR with exact critical values", "Lawshe's table and its recalculation, for comparison", "Congruence: item-objective alignment", "Missing ratings", "Plotting expert evidence", "Reporting", "References" ], "created": "2026-09-01 21:30:49", "modified": "2026-09-28 20:48:30", "commits": 11 }, { "source": "handoff-to-empirical-validation.Rmd", "filename": "handoff-to-empirical-validation.html", "title": "From Content Validity to Empirical Validation", "engine": "knitr::rmarkdown", "headings": [ "Where content validity stops", "A worked panel", "The handoff", "What the object holds", "How much evidence is behind each number", "Constructs", "Into an empirical workflow", "What the handoff does not claim", "Reporting the transition" ], "created": "2026-09-16 10:43:38", "modified": "2026-09-28 16:57:03", "commits": 5 }, { "source": "getting-started.Rmd", "filename": "getting-started.html", "title": "Getting Started with contentvalidR", "engine": "knitr::rmarkdown", "headings": [ "References" ], "created": "2025-08-27 21:11:21", "modified": "2026-09-27 03:41:09", "commits": 7 }, { "source": "reading-output.Rmd", "filename": "reading-output.html", "title": "How to Read contentvalidR Output", "engine": "knitr::rmarkdown", "headings": [ "Who this is for", "The shared vocabulary", "Reading an item-sort result", "The benchmark trap", "Reading expert-panel evidence", "Reading the intervals", "Reading panel agreement", "Reading judge heterogeneity", "Reading domain coverage", "Common misreadings", "Writing it up", "Turning off the inline key", "References" ], "created": "2026-09-13 23:00:45", "modified": "2026-09-27 03:41:09", "commits": 8 }, { "source": "item-sort-validity.Rmd", "filename": "item-sort-validity.html", "title": "Item-Sort Content Validation: Anderson-Gerbing to Howard-Melloy to Colquitt", "engine": "knitr::rmarkdown", "headings": [ "What this workflow answers", "A reproducible example", "Item-level inference: Howard-Melloy", "Scale-level interpretation: Colquitt et al. (2019)", "Correlation-conditional norms", "Judge type matters", "Planning judge sample size", "Plotting item evidence", "Earlier rules, for comparison only", "Reporting", "References" ], "created": "2026-08-31 17:01:16", "modified": "2026-09-27 12:20:08", "commits": 7 }, { "source": "reporting-examples.Rmd", "filename": "reporting-examples.html", "title": "Manuscript-Ready Reporting Examples", "engine": "knitr::rmarkdown", "headings": [ "Purpose", "Item-sort study", "Methods scaffold", "Results scaffold", "Construct-rating study", "Expert-panel study", "Relevance", "Essentiality", "Congruence", "Figures across review stages", "Minimum reproducibility statement", "Language to avoid", "References" ], "created": "2026-09-02 13:31:10", "modified": "2026-09-28 16:57:03", "commits": 4 }, { "source": "one-item-set-both-stages.Rmd", "filename": "one-item-set-both-stages.html", "title": "One Item Set, Both Stages", "engine": "knitr::rmarkdown", "headings": [ "The claim this walkthrough is testing", "The construct and the items", "Stage one: the expert panel", "The handoff", "Stage two: what the responses say", "Recode first, and see why it matters", "Two factors", "The item you should keep anyway", "What a second stage adds beyond factors", "The moral, stated plainly", "Reproducing the data", "References" ], "created": "2026-09-23 00:54:37", "modified": "2026-09-28 11:21:07", "commits": 5 } ], "_score": 4.3979400086720375, "_indexed": true, "_nocasepkg": "contentvalidr", "_universes": [ "juhalt" ], "_previous": "0.10.0", "_binaries": [ { "r": "4.7.0", "os": "linux", "version": "0.10.1", "date": "2026-09-29T08:52:24.000Z", "distro": "resolute", "commit": "4c13be087f2b2fd0dc7179525265b25c9160f0e5", "fileid": "https://r2.ropensci.org/a2900f82f18d16e52a02ab4400d11807522fa5fdba5face9289888b9336e7f28", "status": "success", "check": "OK", "buildurl": "https://github.com/r-universe/juhalt/actions/runs/36544891774" }, { "r": "4.6.1", "os": "linux", "version": "0.10.1", "date": "2026-09-29T08:52:06.000Z", "distro": "resolute", "commit": "4c13be087f2b2fd0dc7179525265b25c9160f0e5", "fileid": "https://r2.ropensci.org/6945dfd287e55d8db0aece63bc8a9491c2bbb6f916753fd0e92ed9c121565653", "status": "success", "check": "OK", "buildurl": "https://github.com/r-universe/juhalt/actions/runs/36544891774" }, { "r": "4.5.3", "os": "mac", "version": "0.10.1", "date": "2026-09-29T09:00:49.000Z", "commit": "4c13be087f2b2fd0dc7179525265b25c9160f0e5", "fileid": "https://r2.ropensci.org/fc695b9a4c7c0ad0f5c777955a7fa1a47b2d2ce17350ddbb74d6595f7d618a3b", "status": "success", "check": "OK", "buildurl": "https://github.com/r-universe/juhalt/actions/runs/36544891774" }, { "r": "4.6.1", "os": "mac", "version": "0.10.1", "date": "2026-09-29T09:03:20.000Z", "commit": "4c13be087f2b2fd0dc7179525265b25c9160f0e5", "fileid": "https://r2.ropensci.org/bc9c8e438ee8cabe2f8c3d1feb23a5f470268c4e837561cb97adaabfddf3bf1e", "status": "success", "check": "OK", "buildurl": "https://github.com/r-universe/juhalt/actions/runs/36544891774" }, { "r": "4.6.0", "os": "wasm", "version": "0.10.1", "date": "2026-09-29T08:51:56.000Z", "commit": "4c13be087f2b2fd0dc7179525265b25c9160f0e5", "fileid": "https://r2.ropensci.org/93f386b965c4618e61fd9204e4649d15d60d78cc11512c727ac4c3009f0e4cf4", "status": "success", "buildurl": "https://github.com/r-universe/juhalt/actions/runs/36544891774" }, { "r": "4.7.0", "os": "win", "version": "0.10.1", "date": "2026-09-29T08:51:19.000Z", "commit": "4c13be087f2b2fd0dc7179525265b25c9160f0e5", "fileid": "https://r2.ropensci.org/faaff3724ca1e8a7b105943923505e79f947d329ef41fc50de612e2403d6a821", "status": "success", "check": "OK", "buildurl": "https://github.com/r-universe/juhalt/actions/runs/36544891774" }, { "r": "4.5.3", "os": "win", "version": "0.10.1", "date": "2026-09-29T08:51:21.000Z", "commit": "4c13be087f2b2fd0dc7179525265b25c9160f0e5", "fileid": "https://r2.ropensci.org/6dd7c2222f60b938bf536f3573542a372fa6e0b83fbe0debe67fb098049cfd79", "status": "success", "check": "OK", "buildurl": "https://github.com/r-universe/juhalt/actions/runs/36544891774" }, { "r": "4.6.1", "os": "win", "version": "0.10.1", "date": "2026-09-29T08:51:11.000Z", "commit": "4c13be087f2b2fd0dc7179525265b25c9160f0e5", "fileid": "https://r2.ropensci.org/511e989f5daeb4000b9fde8c482fbc21c5c7465b6781e0b7ffce8d2aeeb0d478", "status": "success", "check": "OK", "buildurl": "https://github.com/r-universe/juhalt/actions/runs/36544891774" } ] }