Showing 1–21 of 21 results for author: Hand, D

Structural Parameters for Dense Temporal Graphs

Authors: Jessica Enright, Samuel D. Hand, Laura Larios-Jones, Kitty Meeks

Abstract: Temporal graphs provide a useful model for many real-world networks. Unfortunately the majority of algorithmic problems we might consider on such graphs are intractable. There has been recent progress in defining structural parameters which describe tractable cases by simultaneously restricting the underlying structure and the times at which edges appear in the graph. These all rely on the tempora… ▽ More Temporal graphs provide a useful model for many real-world networks. Unfortunately the majority of algorithmic problems we might consider on such graphs are intractable. There has been recent progress in defining structural parameters which describe tractable cases by simultaneously restricting the underlying structure and the times at which edges appear in the graph. These all rely on the temporal graph being sparse in some sense. We introduce temporal analogues of three increasingly restrictive static graph parameters -- cliquewidth, modular-width and neighbourhood diversity -- which take small values for highly structured temporal graphs, even if a large number of edges are active at each timestep. The computational problems solvable efficiently when the temporal cliquewidth of the input graph is bounded form a subset of those solvable efficiently when the temporal modular-width is bounded, which is in turn a subset of problems efficiently solvable when the temporal neighbourhood diversity is bounded. By considering specific temporal graph problems, we demonstrate that (up to standard complexity theoretic assumptions) these inclusions are strict. △ Less

Submitted 30 April, 2024; originally announced April 2024.

Comments: 27 pages, 2 figures

Monitoring AGNs with H$β$ Asymmetry. IV. First Reverberation Mapping Results of 14 AGNs

Authors: T. E. Zastrocky, Michael S. Brotherton, Pu Du, Jacob N. McLane, Kianna A. Olson, D. A. Dale, H. A. Kobulnicky, Jaya Maithil, My L. Nguyen, William T. Chick, David H. Kasper, Derek Hand, C. Adelman, Z. Carter, G. Murphree, M. Oeur, T. Roth, S. Schonsberg, M. J. Caradonna, J. Favro, A. J. Ferguson, I. M. Gonzalez, L. M. Hadding, H. D. Hagler, C. J. Rogers , et al. (19 additional authors not shown)

Abstract: We report first-time reverberation mapping results for 14 AGNs from the ongoing Monitoring AGNs with H$β$ Asymmetry campaign (MAHA). These results utilize optical spectra obtained with the Long Slit Spectrograph on the Wyoming Infrared 2.3m Telescope between 2017 November-2023 May. MAHA combines long-duration monitoring with high cadence. We report results from multiple observing seasons for 9 of… ▽ More We report first-time reverberation mapping results for 14 AGNs from the ongoing Monitoring AGNs with H$β$ Asymmetry campaign (MAHA). These results utilize optical spectra obtained with the Long Slit Spectrograph on the Wyoming Infrared 2.3m Telescope between 2017 November-2023 May. MAHA combines long-duration monitoring with high cadence. We report results from multiple observing seasons for 9 of the 14 objects. These results include H$β$ time lags, supermassive black hole masses, and velocity-resolved time lags. The velocity-resolved lags allow us to investigate the kinematics of the broad-line region. △ Less

Submitted 10 April, 2024; originally announced April 2024.

Comments: 35 pages, 19 figures, accepted for publication in ApJ Supplement

Monitoring AGNs with H$β$ Asymmetry. III. Long-term Reverberation Mapping Results of 15 Palomar-Green Quasars

Authors: Dong-Wei Bao, Michael S. Brotherton, Pu Du, Jacob N. McLane, T. E. Zastrocky, Kianna A. Olson, Feng-Na Fang, Shuo Zhai, Zheng-Peng Huang, Kai Wang, Bi-Xuan Zhao, Sha-Sha Li, Sen Yang, Yong-Jie Chen, Jun-Rong Liu, Zhu-Heng Yao, Yue-Chang Peng, Wei-Jian Guo, Yu-Yang Songsheng, Yan-Rong Li, Bo-Wei Jiang, David H. Kasper, William T. Chick, My L. Nguyen, Jaya Maithil , et al. (20 additional authors not shown)

Abstract: In this third paper of the series reporting on the reverberation mapping (RM) campaign of active galactic nuclei with asymmetric H$β$ emission-line profiles, we present results for 15 Palomar-Green (PG) quasars using spectra obtained between the end of 2016 to May 2021. This campaign combines long time spans with relatively high cadence. For 8 objects, both the time lags obtained from the entire l… ▽ More In this third paper of the series reporting on the reverberation mapping (RM) campaign of active galactic nuclei with asymmetric H$β$ emission-line profiles, we present results for 15 Palomar-Green (PG) quasars using spectra obtained between the end of 2016 to May 2021. This campaign combines long time spans with relatively high cadence. For 8 objects, both the time lags obtained from the entire light curves and the measurements from individual observing seasons are provided. Reverberation mapping of 9 of our targets has been attempted for the first time, while the results for 6 others can be compared with previous campaigns. We measure the H$β$ time lags over periods of years and estimate their black hole masses. The long duration of the campaign enables us to investigate their broad line region (BLR) geometry and kinematics for different years by using velocity-resolved lags, which demonstrate signatures of diverse BLR geometry and kinematics. The BLR geometry and kinematics of individual objects are discussed. In this sample, the BLR kinematics of Keplerian/virialized motion and inflow is more common than outflow. △ Less

Submitted 1 July, 2022; originally announced July 2022.

Comments: 35 pages, 18 figures, 8 tables, accepted for publication in The Astrophysical Journal Supplement

Notes on the H-measure of classifier performance

Authors: D. J. Hand, C. Anagnostopoulos

Abstract: The H-measure is a classifier performance measure which takes into account the context of application without requiring a rigid value of relative misclassification costs to be set. Since its introduction in 2009 it has become widely adopted. This paper answers various queries which users have raised since its introduction, including questions about its interpretation, the choice of a weighting fun… ▽ More The H-measure is a classifier performance measure which takes into account the context of application without requiring a rigid value of relative misclassification costs to be set. Since its introduction in 2009 it has become widely adopted. This paper answers various queries which users have raised since its introduction, including questions about its interpretation, the choice of a weighting function, whether it is strictly proper, and its coherence, and relates the measure to other work. △ Less

Submitted 31 December, 2021; v1 submitted 22 June, 2021; originally announced June 2021.

Comments: 13 pages

Trustworthiness of statistical inference

Authors: David J. Hand

Abstract: We examine the role of trustworthiness and trust in statistical inference, arguing that it is the extent of trustworthiness in inferential statistical tools which enables trust in the conclusions. Certain tools, such as the p-value and significance test, have recently come under renewed criticism, with some arguing that they damage trust in statistics. We argue the contrary, beginning from the pos… ▽ More We examine the role of trustworthiness and trust in statistical inference, arguing that it is the extent of trustworthiness in inferential statistical tools which enables trust in the conclusions. Certain tools, such as the p-value and significance test, have recently come under renewed criticism, with some arguing that they damage trust in statistics. We argue the contrary, beginning from the position that the central role of these methods is to form the basis for trusted conclusions in the face of uncertainty in the data, and noting that it is the misuse and misunderstanding of these tools which damages trustworthiness and hence trust. We go on to argue that recent calls to ban these tools would tackle the symptom, not the cause, and themselves risk damaging the capability of science to advance, and feeding into public suspicion of the discipline of statistics. The consequence could be aggravated mistrust of our discipline and of science more generally. In short, the very proposals could work in quite the contrary direction from that intended. We make some alternative proposals for tackling the misuse and misunderstanding of these methods, and for how trust in our discipline might be promoted. △ Less

Submitted 9 May, 2021; originally announced May 2021.

Monitoring AGNs with Hβ Asymmetry. II. Reverberation Mapping of Three Seyfert Galaxies Historically Displaying Hβ Profiles with Changing Asymmetry: Mrk 79, NGC 3227, and Mrk 841

Authors: Michael S. Brotherton, Pu Du, Ming Xiao, Dong-Wei Bao, Bixuan Zhao, Jacob N. McLane, Kianna A. Olson, Kai Wang, Zheng-Peng Huang, Chen Hu, David H. Kasper, William T. Chick, My L. Nguyen, Jaya Maithil, Derek Hand, Yan-Rong Li, Luis C. Ho, Jin-Ming Bai, Wei-Hao Bian, Jian-Min Wang

Abstract: We report the results of reverberation mapping three bright Seyfert galaxies, Mrk 79, NGC 3227, and Mrk 841, from a campaign conducted from December 2016 to May 2017 with the Wyoming Infrared Observatory (WIRO) 2.3-meter telescope. All three of these targets have shown asymmetric broad H$β$ emission lines in the past, although their emission lines were relatively symmetric during our observations.… ▽ More We report the results of reverberation mapping three bright Seyfert galaxies, Mrk 79, NGC 3227, and Mrk 841, from a campaign conducted from December 2016 to May 2017 with the Wyoming Infrared Observatory (WIRO) 2.3-meter telescope. All three of these targets have shown asymmetric broad H$β$ emission lines in the past, although their emission lines were relatively symmetric during our observations. We measured Hβ time lags for all three targets and estimated masses of their black holes -- for the first time in the case of Mrk 841. For Mrk 79 and NGC 3227, the data are of sufficient quality to resolve distinct time lags as a function of velocity and to compute two-dimensional velocity-delay maps. Mrk 79 shows smaller time lags for high-velocity gas but the distribution is not symmetric, and its complex velocity-delay map could result from the combination of both inflowing and outflowing Hβ emitting disks that may be part of a single larger structure. NGC 3227 shows the largest time lags for blueshifted gas and the two-dimensional velocity-delay map suggests a disk with some inflow. We compare our results with previous work and find evidence for different time lags despite similar luminosities, as well as evolving broad line region structures. △ Less

Submitted 11 November, 2020; originally announced November 2020.

Comments: 18 pages, 9 figures, 7 tables (table 3 is machine-readable and may be found in the source files as table3.txt), accepted by ApJ

F*: An Interpretable Transformation of the F-measure

Authors: David J. Hand, Peter Christen, Nishadi Kirielle

Abstract: The F-measure, also known as the F1-score, is widely used to assess the performance of classification algorithms. However, some researchers find it lacking in intuitive interpretation, questioning the appropriateness of combining two aspects of performance as conceptually distinct as precision and recall, and also questioning whether the harmonic mean is the best way to combine them. To ease this… ▽ More The F-measure, also known as the F1-score, is widely used to assess the performance of classification algorithms. However, some researchers find it lacking in intuitive interpretation, questioning the appropriateness of combining two aspects of performance as conceptually distinct as precision and recall, and also questioning whether the harmonic mean is the best way to combine them. To ease this concern, we describe a simple transformation of the F-measure, which we call F* (F-star), which has an immediate practical interpretation. △ Less

Submitted 17 March, 2021; v1 submitted 31 July, 2020; originally announced August 2020.

Comments: 7 pages

No Clear, Direct Evidence for Multiple Protoplanets Orbiting LkCa 15: LkCa 15 bcd are Likely Inner Disk Signals

Authors: Thayne Currie, Christian Marois, Lucas Cieza, Gijs Mulders, Kellen Lawson, Claudio Caceres, Dary Rodriguez-Ruiz, John Wisniewski, Olivier Guyon, Timothy Brandt, N. Jeremy Kasdin, Tyler Groff, Julien Lozi, Jeffrey Chilcote, Klaus Hodapp, Nemanja Jovanovic, Frantz Martinache, Nour Skaf, Wladimir Lyra, Motohide Tamura, Ruben Asensio-Torres, Ruobing Dong, Carol Grady, Misato Fukagawa, Derek Hand , et al. (7 additional authors not shown)

Abstract: Two studies utilizing sparse aperture masking (SAM) interferometry and $H_{\rm α}$ differential imaging have reported multiple jovian companions around the young solar-mass star, LkCa 15 (LkCa 15 bcd): the first claimed direct detection of infant, newly-formed planets ("protoplanets"). We present new near-infrared direct imaging/spectroscopy from the SCExAO system coupled with the CHARIS integral… ▽ More Two studies utilizing sparse aperture masking (SAM) interferometry and $H_{\rm α}$ differential imaging have reported multiple jovian companions around the young solar-mass star, LkCa 15 (LkCa 15 bcd): the first claimed direct detection of infant, newly-formed planets ("protoplanets"). We present new near-infrared direct imaging/spectroscopy from the SCExAO system coupled with the CHARIS integral field spectrograph and multi-epoch thermal infrared imaging from Keck/NIRC2 of LkCa 15 at high Strehl ratios. These data provide the first direct imaging look at the same wavelengths and in the same locations where previous studies identified the LkCa 15 protoplanets and thus offer the first decisive test of their existence. The data do not reveal these planets. Instead, we resolve extended emission tracing a dust disk with a brightness and location comparable to that claimed for LkCa 15 bcd. Forward-models attributing this signal to orbiting planets are inconsistent with the combined SCExAO/CHARIS and Keck/NIRC2 data. An inner disk provides a more compelling explanation for the SAM detections and perhaps also the claimed $H_α$ detection of LkCa 15 b. We conclude that there is currently no clear, direct evidence for multiple protoplanets orbiting LkCa 15, although the system likely contains at least one unseen jovian companion. To identify jovian companions around LkCa 15 from future observations, the inner disk should be detected and its effect modeled, removed, and shown to be distinguishable from planets. Protoplanet candidates identified from similar systems should likewise be clearly distinguished from disk emission through modeling. △ Less

Submitted 10 May, 2019; originally announced May 2019.

Comments: 12 pages, 4 figures, 1 table; Astrophysical Journal Letters in press

Low-Latitude Aurorae during the Extreme Space Weather Events in 1859

Authors: Hisashi Hayakawa, Yusuke Ebihara, David P. Hand, Satoshi Hayakawa, Sandeep Kumar, Shyamoli Mukherjee, B. Veenadhari

Abstract: The Carrington storm (September 1/2, 1859) is one of the largest magnetic storms ever observed and it has caused global auroral displays in low-latitude areas, together with a series of multiple magnetic storms during August 28 and September 4, 1859. In this study, we revisit contemporary auroral observation records to extract information on their elevation angle, color, and direction to investiga… ▽ More The Carrington storm (September 1/2, 1859) is one of the largest magnetic storms ever observed and it has caused global auroral displays in low-latitude areas, together with a series of multiple magnetic storms during August 28 and September 4, 1859. In this study, we revisit contemporary auroral observation records to extract information on their elevation angle, color, and direction to investigate this stormy interval in detail. We first examine their equatorward boundary of "auroral emission with multiple colors" based on descriptions of elevation angle and color. We find that their locations were 36.5 deg ILAT on August 28/29 and 32.7 deg ILAT on September 1/2, suggesting that trapped electrons moved to, at least, L~1.55 and L~1.41, respectively. The equatorward boundary of "purely red emission" was likely located at 30.8 deg ILAT on September 1/2. If "purely red emission" was a stable auroral red arc, it would suggest that trapped protons moved to, at least, L~1.36. This reconstruction with observed auroral emission regions provides conservative estimations of magnetic storm intensities. We compare the auroral records with magnetic observations. We confirm that multiple magnetic storms occurred during this stormy interval, and that the equatorward expansion of the auroral oval is consistent with the timing of magnetic disturbances. It is possible that the August 28/29 interplanetary coronal mass ejections (ICMEs) cleared out the interplanetary medium, making the ICMEs for the Carrington storm on September 1/2 more geoeffective. △ Less

Submitted 7 November, 2018; originally announced November 2018.

Comments: Main Text 28 pages, References 11 pages, and Appendix 3 pages with 5 figures. The data table will be shown in the record version. This paper was accepted for publication in the Astrophysical Journal on 2018 September 26

Journal ref: The Astrophysical Journal, 2018

Monitoring AGNs with Hβ Asymmetry. I. First Results: Velocity-resolved Reverberation Mapping

Authors: Pu Du, Michael S. Brotherton, Kai Wang, Zheng-Peng Huang, Chen Hu, David H. Kasper, William T. Chick, My L. Nguyen, Jaya Maithil, Derek Hand, Yan-Rong Li, Luis C. Ho, Jin-Ming Bai, Wei-Hao Bian, Jian-Min Wang

Abstract: We have started a long-term reverberation mapping project using the Wyoming Infrared Observatory 2.3 meter telescope titled "Monitoring AGNs with Hβ Asymmetry" (MAHA). The motivations of the project are to explore the geometry and kinematics of the gas responsible for complex Hβ emission-line profiles, ideally leading to an understanding of the structures and origins of the broad-line region (BLR)… ▽ More We have started a long-term reverberation mapping project using the Wyoming Infrared Observatory 2.3 meter telescope titled "Monitoring AGNs with Hβ Asymmetry" (MAHA). The motivations of the project are to explore the geometry and kinematics of the gas responsible for complex Hβ emission-line profiles, ideally leading to an understanding of the structures and origins of the broad-line region (BLR). Furthermore, such a project provides the opportunity to search for evidence of close binary supermassive black holes. We describe MAHA and report initial results from our first campaign, from December 2016 to May 2017, highlighting velocity-resolved time lags for four AGNs with asymmetric Hβ lines. We find that 3C 120, Ark 120, and Mrk 6 display complex features different from the simple signatures expected for pure outflow, inflow, or a Keplerian disk. While three of the objects have been previously reverberation mapped, including velocity-resolved time lags in the cases of 3C 120 and Mrk 6, we report a time lag and corresponding black hole mass measurement for SBS 1518+593 for the first time. Furthermore, SBS 1518+593, the least asymmetric of the four, does show velocity-resolved time lags characteristic of a Keplerian disk or virialized motion more generally. Also, the velocity-resolved time lags of 3C 120 have significantly changed since previously observed, indicating an evolution of its BLR structure. Future analyses of the data for these objects and others in MAHA will explore the full diversity of Hβ lines and the physics of AGN BLRs. △ Less

Submitted 29 October, 2018; originally announced October 2018.

Comments: 19 pages, 6 figures, 7 tables, accepted for publication in The Astrophysical Journal

Warm Molecular Hydrogen in Nearby, Luminous Infrared Galaxies

Authors: Andreea O. Petric, Lee Armus, Nicolas Flagey, Pierre Guillard, Justin Howell, Hanae Inami, Vassillis Charmandaris, Aaron Evans, Sabrina Stierwalt, Tanio Diaz-Santos, Nanyao Lu, Henrik Spoon, Joe Mazzarella, Phil Appleton, Ben Chan, Jason Chu, Derek Hand, George Privon, David Sanders, Jason Surace, Kevin Xu, Yinghe Zhao

Abstract: Mid-infrared molecular hydrogen (H$_2$) emission is a powerful cooling agent in galaxy mergers and in radio galaxies; it is a potential key tracer of gas evolution and energy dissipation associated with mergers, star formation, and accretion onto supermassive black holes. We detect mid-IR H$_2$ line emission in at least one rotational transition in 91\% of the 214 Luminous Infrared Galaxies (LIRGs… ▽ More Mid-infrared molecular hydrogen (H$_2$) emission is a powerful cooling agent in galaxy mergers and in radio galaxies; it is a potential key tracer of gas evolution and energy dissipation associated with mergers, star formation, and accretion onto supermassive black holes. We detect mid-IR H$_2$ line emission in at least one rotational transition in 91\% of the 214 Luminous Infrared Galaxies (LIRGs) observed with Spitzer as part of the Great Observatories All-sky LIRG Survey (GOALS). We use H$_2$ excitation diagrams to estimate the range of masses and temperatures of warm molecular gas in these galaxies. We find that LIRGs in which the IR emission originates mostly from the Active Galactic Nuclei (AGN) have about 100K higher H$_2$ mass-averaged excitation temperatures than LIRGs in which the IR emission originates mostly from star formation. Between 10 and 15\% of LIRGs have H$_2$ emission lines that are sufficiently broad to be resolved or partially resolved by the high resolution modules of Spitzer's Infrared Spectrograph (IRS). Those sources tend to be mergers and contain AGN. This suggests that a significant fraction of the H$_2$ line emission is powered by AGN activity through X-rays, cosmic rays, and turbulence. We find a statistically significant correlation between the kinetic energy in the H$_2$ gas and the H$_2$ to IR luminosity ratio. The sources with the largest warm gas kinetic energies are mergers. We speculate that mergers increase the production of bulk in-flows leading to observable broad H$_2$ profiles and possibly denser environments. △ Less

Submitted 24 May, 2018; originally announced May 2018.

Comments: 31 pages, 12 figures, 7 tables, accepted for publication in the Astrophysical Journal

Mid-infrared characterization of the planetary-mass companion ROXs 42B b

Authors: Sebastian Daemgen, Kamen Todorov, Jasmin Silva, Derek Hand, Eugenio V. Garcia, Thayne Currie, Adam Burrows, Keivan G. Stassun, Thorsten Ratzka, John H. Debes, David Lafreniere, Ray Jayawardhana, Serge Correia

Abstract: We present new Keck/NIRC2 3$-$5 $μ$m infrared photometry of the planetary-mass companion to ROXS 42B in $L^\prime$, and for the first time in Brackett-$α$ (Br$α$) and in $M_\mathrm{s}$-band. We combine our data with existing near-infrared photometry and $K$-band (2$-$2.4 $μ$m) spectroscopy and compare these with models and other directly imaged planetary-mass objects using forward modeling and ret… ▽ More We present new Keck/NIRC2 3$-$5 $μ$m infrared photometry of the planetary-mass companion to ROXS 42B in $L^\prime$, and for the first time in Brackett-$α$ (Br$α$) and in $M_\mathrm{s}$-band. We combine our data with existing near-infrared photometry and $K$-band (2$-$2.4 $μ$m) spectroscopy and compare these with models and other directly imaged planetary-mass objects using forward modeling and retrieval methods in order to characterize the atmosphere of ROXS 42B b. ROXS 42B b's 1.25$-$5 $μ$m spectral energy distribution most closely resembles that of GSC 06214 B and $κ$ And b, although it has a slightly bluer $K_{\rm s}$$-$$M_{\rm s}$ color than GSC 06214 B and thus so far lacks evidence for a circumplanetary disk. We cannot formally exclude the possibility that any of the tested dust-free/dusty/cloudy forward models describe atmosphere of ROXS 42B b well. However, models with substantial atmospheric dust/clouds yield temperatures and gravities that are consistent when fit to photometry and spectra separately, whereas dust-free model fits to photometry predict temperatures/gravities inconsistent with ROXS 42B b's $K$-band spectrum and vice-versa. Atmospheric retrieval on the 1$-$5 $μ$m photometry places a limit on the fractional number density of CO$_2$ of $\log(n_{\rm CO_2})<-2.7$ but provides no other constraints so far. We conclude that ROXS 42B b has mid-IR photometric features that are systematically different from other previously observed planetary-mass and field objects of similar temperature. It remains unclear whether this is in the range of the natural diversity of targets at the very young ($\sim$2 Myr) age of ROXS 42B b, or unique to its early evolution and environment. △ Less

Submitted 2 March, 2017; v1 submitted 21 February, 2017; originally announced February 2017.

Comments: 11 pages, 8 figures. Accepted for publication in Astronomy & Astrophysics

Journal ref: A&A 601, A65 (2017)

Wonderful Examples, but Let's not Close Our Eyes

Authors: David J. Hand

Abstract: The papers in this collection are superb illustrations of the power of modern Bayesian methods. They give examples of problems which are well suited to being tackled using such methods, but one must not lose sight of the merits of having multiple different strategies and tools in one's inferential armoury. The papers in this collection are superb illustrations of the power of modern Bayesian methods. They give examples of problems which are well suited to being tackled using such methods, but one must not lose sight of the merits of having multiple different strategies and tools in one's inferential armoury. △ Less

Submitted 20 May, 2014; originally announced May 2014.

Comments: Published in at http://dx.doi.org/10.1214/13-STS446 the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-STS-STS446

Journal ref: Statistical Science 2014, Vol. 29, No. 1, 98-100

Exponentially Weighted Moving Average Charts for Detecting Concept Drift

Authors: Gordon J. Ross, Niall M. Adams, Dimitris K. Tasoulis, David J. Hand

Abstract: Classifying streaming data requires the development of methods which are computationally efficient and able to cope with changes in the underlying distribution of the stream, a phenomenon known in the literature as concept drift. We propose a new method for detecting concept drift which uses an Exponentially Weighted Moving Average (EWMA) chart to monitor the misclassification rate of an streaming… ▽ More Classifying streaming data requires the development of methods which are computationally efficient and able to cope with changes in the underlying distribution of the stream, a phenomenon known in the literature as concept drift. We propose a new method for detecting concept drift which uses an Exponentially Weighted Moving Average (EWMA) chart to monitor the misclassification rate of an streaming classifier. Our approach is modular and can hence be run in parallel with any underlying classifier to provide an additional layer of concept drift detection. Moreover our method is computationally efficient with overhead O(1) and works in a fully online manner with no need to store data points in memory. Unlike many existing approaches to concept drift detection, our method allows the rate of false positive detections to be controlled and kept constant over time. △ Less

Submitted 25 December, 2012; originally announced December 2012.

Journal ref: Pattern Recognition Letters, 33(2) 191-198, 2012

A better Beta for the H measure of classification performance

Authors: David J. Hand, Christoforos Anagnostopoulos

Abstract: The area under the ROC curve is widely used as a measure of performance of classification rules. However, it has recently been shown that the measure is fundamentally incoherent, in the sense that it treats the relative severities of misclassifications differently when different classifiers are used. To overcome this, Hand (2009) proposed the $H$ measure, which allows a given researcher to fix the… ▽ More The area under the ROC curve is widely used as a measure of performance of classification rules. However, it has recently been shown that the measure is fundamentally incoherent, in the sense that it treats the relative severities of misclassifications differently when different classifiers are used. To overcome this, Hand (2009) proposed the $H$ measure, which allows a given researcher to fix the distribution of relative severities to a classifier-independent setting on a given problem. This note extends the discussion, and proposes a modified standard distribution for the $H$ measure, which better matches the requirements of researchers, in particular those faced with heavily unbalanced datasets, the $Beta(π_1+1,π_0+1)$ distribution. [Preprint submitted at Pattern Recognition Letters] △ Less

Submitted 1 August, 2013; v1 submitted 12 February, 2012; originally announced February 2012.

Comments: Preprint. Keywords: supervised classification, classifier performance, AUC, ROC curve, H measure

Discussion of "Bayesian Models and Methods in Public Policy and Government Settings" by S. E. Fienberg

Authors: David J. Hand

Abstract: Fienberg convincingly demonstrates that Bayesian models and methods represent a powerful approach to squeezing illumination from data in public policy settings. However, no school of inference is without its weaknesses, and, in the face of the ambiguities, uncertainties, and poorly posed questions of the real world, perhaps we should not expect to find a formally correct inferential strategy which… ▽ More Fienberg convincingly demonstrates that Bayesian models and methods represent a powerful approach to squeezing illumination from data in public policy settings. However, no school of inference is without its weaknesses, and, in the face of the ambiguities, uncertainties, and poorly posed questions of the real world, perhaps we should not expect to find a formally correct inferential strategy which can be universally applied, whatever the nature of the question: we should not expect to be able to identify a "norm" approach. An analogy is made between George Box's "no models are right, but some are useful," and inferential systems [arXiv:1108.2177]. △ Less

Submitted 18 August, 2011; originally announced August 2011.

Comments: Published in at http://dx.doi.org/10.1214/11-STS331A the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-STS-STS331A

Journal ref: Statistical Science 2011, Vol. 26, No. 2, 227-230

A Bayesian approach to star-galaxy classification

Authors: Marc Henrion, Daniel J. Mortlock, David J. Hand, Axel Gandy

Abstract: Star-galaxy classification is one of the most fundamental data-processing tasks in survey astronomy, and a critical starting point for the scientific exploitation of survey data. For bright sources this classification can be done with almost complete reliability, but for the numerous sources close to a survey's detection limit each image encodes only limited morphological information. In this regi… ▽ More Star-galaxy classification is one of the most fundamental data-processing tasks in survey astronomy, and a critical starting point for the scientific exploitation of survey data. For bright sources this classification can be done with almost complete reliability, but for the numerous sources close to a survey's detection limit each image encodes only limited morphological information. In this regime, from which many of the new scientific discoveries are likely to come, it is vital to utilise all the available information about a source, both from multiple measurements and also prior knowledge about the star and galaxy populations. It is also more useful and realistic to provide classification probabilities than decisive classifications. All these desiderata can be met by adopting a Bayesian approach to star-galaxy classification, and we develop a very general formalism for doing so. An immediate implication of applying Bayes's theorem to this problem is that it is formally impossible to combine morphological measurements in different bands without using colour information as well; however we develop several approximations that disregard colour information as much as possible. The resultant scheme is applied to data from the UKIRT Infrared Deep Sky Survey (UKIDSS), and tested by comparing the results to deep Sloan Digital Sky Survey (SDSS) Stripe 82 measurements of the same sources. The Bayesian classification probabilities obtained from the UKIDSS data agree well with the deep SDSS classifications both overall (a mismatch rate of 0.022, compared to 0.044 for the UKIDSS pipeline classifier) and close to the UKIDSS detection limit (a mismatch rate of 0.068 compared to 0.075 for the UKIDSS pipeline classifier). The Bayesian formalism developed here can be applied to improve the reliability of any star-galaxy classification schemes based on the measured values of morphology statistics alone. △ Less

Submitted 26 November, 2010; originally announced November 2010.

Comments: Accepted 22 November 2010, 19 pages, 17 figures

MSC Class: 62P35

Journal ref: MNRAS (2011) 412 (4): 2286-2302

Bayesian anomaly detection methods for social networks

Authors: Nicholas A. Heard, David J. Weston, Kiriaki Platanioti, David J. Hand

Abstract: Learning the network structure of a large graph is computationally demanding, and dynamically monitoring the network over time for any changes in structure threatens to be more challenging still. This paper presents a two-stage method for anomaly detection in dynamic graphs: the first stage uses simple, conjugate Bayesian models for discrete time counting processes to track the pairwise links of a… ▽ More Learning the network structure of a large graph is computationally demanding, and dynamically monitoring the network over time for any changes in structure threatens to be more challenging still. This paper presents a two-stage method for anomaly detection in dynamic graphs: the first stage uses simple, conjugate Bayesian models for discrete time counting processes to track the pairwise links of all nodes in the graph to assess normality of behavior; the second stage applies standard network inference tools on a greatly reduced subset of potentially anomalous nodes. The utility of the method is demonstrated on simulated and real data sets. △ Less

Submitted 8 November, 2010; originally announced November 2010.

Comments: Published in at http://dx.doi.org/10.1214/10-AOAS329 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOAS-AOAS329

Journal ref: Annals of Applied Statistics 2010, Vol. 4, No. 2, 645-662

UV Direct-Writing of Metals on Polyimide

Authors: Jack Hoyd-Gigg Ng, Marc Desmulliez, Aongus Mccarthy, Himanshu Suyal, Kevin Prior, Duncan P. Hand

Abstract: Conductive micro-patterned copper tracks were fabricated by UV direct-writing of a nanoparticle silver seed layer followed by selective electroless copper deposition. Silver ions were first incorporated into a hydrolyzed polyimide surface layer by wet chemical treatment. A photoreactive polymer coating, methoxy poly(ethylene glycol) (MPEG) was coated on top of the substrate prior to UV irradiati… ▽ More Conductive micro-patterned copper tracks were fabricated by UV direct-writing of a nanoparticle silver seed layer followed by selective electroless copper deposition. Silver ions were first incorporated into a hydrolyzed polyimide surface layer by wet chemical treatment. A photoreactive polymer coating, methoxy poly(ethylene glycol) (MPEG) was coated on top of the substrate prior to UV irradiation. Electrons released through the interaction between the MPEG molecules and UV photons allowed the reduction of the silver ions across the MPEG/doped polyimide interface. The resultant silver seed layer has a cluster morphology which is suitable for the initiation of electroless plating. Initial results showed that the deposited copper tracks were in good agreement with the track width on the photomask and laser direct-writing can also fabricate smaller line width metal tracks with good accuracy. The facile fabrication presented here can be carried out in air, at atmospheric pressure, and on contoured surfaces. △ Less

Submitted 7 May, 2008; originally announced May 2008.

Comments: Submitted on behalf of EDA Publishing Association (http://irevues.inist.fr/handle/2042/16838)

Journal ref: Dans Symposium on Design, Test, Integration and Packaging of MEMS/MOEMS - DTIP 2008, Nice : France (2008)

Rejoinder: Classifier Technology and the Illusion of Progress

Authors: David J. Hand

Abstract: Rejoinder: Classifier Technology and the Illusion of Progress [math.ST/0606441] Rejoinder: Classifier Technology and the Illusion of Progress [math.ST/0606441] △ Less

Submitted 19 June, 2006; originally announced June 2006.

Comments: Published at http://dx.doi.org/10.1214/088342306000000079 in the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-STS-STS155REJ

Journal ref: Statistical Science 2006, Vol. 21, No. 1, 30-34

Classifier Technology and the Illusion of Progress

Authors: David J. Hand

Abstract: A great many tools have been developed for supervised classification, ranging from early methods such as linear discriminant analysis through to modern developments such as neural networks and support vector machines. A large number of comparative studies have been conducted in attempts to establish the relative superiority of these methods. This paper argues that these comparisons often fail to… ▽ More A great many tools have been developed for supervised classification, ranging from early methods such as linear discriminant analysis through to modern developments such as neural networks and support vector machines. A large number of comparative studies have been conducted in attempts to establish the relative superiority of these methods. This paper argues that these comparisons often fail to take into account important aspects of real problems, so that the apparent superiority of more sophisticated methods may be something of an illusion. In particular, simple methods typically yield performance almost as good as more sophisticated methods, to the extent that the difference in performance may be swamped by other sources of uncertainty that generally are not considered in the classical supervised classification paradigm. △ Less

Submitted 19 June, 2006; originally announced June 2006.

Comments: This paper commented in: [math.ST/0606447], [math.ST/0606452], [math.ST/0606455], [math.ST/0606457]. Rejoinder in [math.ST/0606461]. Published at http://dx.doi.org/10.1214/088342306000000060 in the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-STS-STS155

Journal ref: Statistical Science 2006, Vol. 21, No. 1, 1-15