Smoothness of a time series: relationship between ARMA model and signal derivativesPosition triangulation of moving nodesGiven a sequence $a_k inmathbbR_+$ find the periodicity of $sumlimits_k sin(a_kx) $The meaning of the connection between power spectral density and auto correlationDoes the power spectral density vanish when the frequency is zero for a zero-mean process?Time series analysis, moving-average model, ARMA modelIs there anybody think about White Noise's distribution function??Autocorrelation of heaviside functionsTo remove the mean value of the Fourier mode from the time seriesTime series analysis armaSample autocorrelation function from multiple realisations of a stochastic processs using the convolution theoremDetermining stochastic process to give a specified autocorrelation functionFor what values of u is this a valid autocorrelation function

How to install round brake pads

Is divide-by-zero a security vulnerability?

Logistic regression BIC: what's the right N?

Does an unused member variable take up memory?

Why is there an extra space when I type "ls" on the Desktop?

What do you call someone who likes to pick fights?

Too soon for a plot twist?

How can I portion out frozen cookie dough?

How to write a chaotic neutral protagonist and prevent my readers from thinking they are evil?

Why does Central Limit Theorem break down in my simulation?

What can I do if someone tampers with my SSH public key?

How to educate team mate to take screenshots for bugs with out unwanted stuff

What to do if my university does not offer any advanced math courses?

Would those living in a "perfect society" not understand satire

Is it a Cyclops number? "Nobody" knows!

Professor forcing me to attend a conference, I can't afford even with 50% funding

Has a sovereign Communist government ever run, and conceded loss, on a fair election?

If sound is a longitudinal wave, why can we hear it if our ears aren't aligned with the propagation direction?

How do we create new idioms and use them in a novel?

(Codewars) Linked Lists-Sorted Insert

How to copy the rest of lines of a file to another file

Locked Away- What am I?

When an outsider describes family relationships, which point of view are they using?

Yet another question on sums of the reciprocals of the primes



Smoothness of a time series: relationship between ARMA model and signal derivatives


Position triangulation of moving nodesGiven a sequence $a_k inmathbbR_+$ find the periodicity of $sumlimits_k sin(a_kx) $The meaning of the connection between power spectral density and auto correlationDoes the power spectral density vanish when the frequency is zero for a zero-mean process?Time series analysis, moving-average model, ARMA modelIs there anybody think about White Noise's distribution function??Autocorrelation of heaviside functionsTo remove the mean value of the Fourier mode from the time seriesTime series analysis armaSample autocorrelation function from multiple realisations of a stochastic processs using the convolution theoremDetermining stochastic process to give a specified autocorrelation functionFor what values of u is this a valid autocorrelation function













0












$begingroup$


I have a discrete stochastic function $f(t_k)$ (in my case, it's a time signal related to atmospheric parameters). I know this function to have a certain smoothness. One way I can specify its smoothness is using its auto-correlation function, or equivalently, its power spectral density which can be estimated by $S_f(omega_k) = mathcalF(f(t_k)) overlinemathcalF(f(t_k))$, where here $mathcalF$ is the discrete Fourier transform over some arbitrary window of data and $bar$ means complex conjugate. Let's assume that the SDF is the a-priori information I have available for defining the signal smoothness.



I want to be able to define sequential or batch estimation algorithms to estimate this signal given noisy measurements. For simplicity, let's say:



$$
y(t_k) = f(t_k) + w(t_k)
$$



is our measurement, where $E[w(t_k)w(t_l)] = sigma^2delta(k-l)$, where $sigma^2$ is the noise variance and $delta$ is the Dirac delta function.



If I want to predict/estimate $hatf(t_k)$ given past estimates $hatf(t_k-1), hatf(t_k-2), dots $, one way to do this is using an auto-regressive (AR) model:



$$
hatf(t_k) = c + sum_i=1^P a_i hatf(t_k-i)
$$



where $c$ and $a_i$ are model coefficients. (There is a direct relationship between an AR model and its corresponding power spectral density, correct?)



Another way is by estimating and using derivatives of $f(t_k-1)$:



$$
hatf(t_k) = hatf(t_k-1) + Delta t hatdotf(t_k-1) + fracDelta t2 hatddotf(t_k-1) + cdots
$$



where $Delta t = t_k - t_k-1$, $dotf$ denotes the first time derivative (i.e. rate) of $f$, and $ddotf$ denotes the second time derivative (i.e. acceleration) of $f$, etc. (I don't at all understand how this method of predicting $f$ relates to its power spectral density.)



Intuitively, I feel there must be a relationship between these two ways of predicting/estimating a smooth function, but I can't quite pin it down, nor find any references that do. So...



What is the relationship between using an auto-regressive model and using function derivatives to predict a smooth signal $f(t_k)$, particularly in regard to knowing a-priori its power spectral density $S_f(omega_k)$.




Thank you for any help/guidance/direction. If this question belongs in another community, please let me know.










share|cite|improve this question











$endgroup$





This question has an open bounty worth +50
reputation from Brian ending ending at 2019-03-11 08:04:20Z">tomorrow.


Looking for an answer drawing from credible and/or official sources.


Please help me (and others) understand the relationship between auto-regressive models and function derivatives.




















    0












    $begingroup$


    I have a discrete stochastic function $f(t_k)$ (in my case, it's a time signal related to atmospheric parameters). I know this function to have a certain smoothness. One way I can specify its smoothness is using its auto-correlation function, or equivalently, its power spectral density which can be estimated by $S_f(omega_k) = mathcalF(f(t_k)) overlinemathcalF(f(t_k))$, where here $mathcalF$ is the discrete Fourier transform over some arbitrary window of data and $bar$ means complex conjugate. Let's assume that the SDF is the a-priori information I have available for defining the signal smoothness.



    I want to be able to define sequential or batch estimation algorithms to estimate this signal given noisy measurements. For simplicity, let's say:



    $$
    y(t_k) = f(t_k) + w(t_k)
    $$



    is our measurement, where $E[w(t_k)w(t_l)] = sigma^2delta(k-l)$, where $sigma^2$ is the noise variance and $delta$ is the Dirac delta function.



    If I want to predict/estimate $hatf(t_k)$ given past estimates $hatf(t_k-1), hatf(t_k-2), dots $, one way to do this is using an auto-regressive (AR) model:



    $$
    hatf(t_k) = c + sum_i=1^P a_i hatf(t_k-i)
    $$



    where $c$ and $a_i$ are model coefficients. (There is a direct relationship between an AR model and its corresponding power spectral density, correct?)



    Another way is by estimating and using derivatives of $f(t_k-1)$:



    $$
    hatf(t_k) = hatf(t_k-1) + Delta t hatdotf(t_k-1) + fracDelta t2 hatddotf(t_k-1) + cdots
    $$



    where $Delta t = t_k - t_k-1$, $dotf$ denotes the first time derivative (i.e. rate) of $f$, and $ddotf$ denotes the second time derivative (i.e. acceleration) of $f$, etc. (I don't at all understand how this method of predicting $f$ relates to its power spectral density.)



    Intuitively, I feel there must be a relationship between these two ways of predicting/estimating a smooth function, but I can't quite pin it down, nor find any references that do. So...



    What is the relationship between using an auto-regressive model and using function derivatives to predict a smooth signal $f(t_k)$, particularly in regard to knowing a-priori its power spectral density $S_f(omega_k)$.




    Thank you for any help/guidance/direction. If this question belongs in another community, please let me know.










    share|cite|improve this question











    $endgroup$





    This question has an open bounty worth +50
    reputation from Brian ending ending at 2019-03-11 08:04:20Z">tomorrow.


    Looking for an answer drawing from credible and/or official sources.


    Please help me (and others) understand the relationship between auto-regressive models and function derivatives.


















      0












      0








      0





      $begingroup$


      I have a discrete stochastic function $f(t_k)$ (in my case, it's a time signal related to atmospheric parameters). I know this function to have a certain smoothness. One way I can specify its smoothness is using its auto-correlation function, or equivalently, its power spectral density which can be estimated by $S_f(omega_k) = mathcalF(f(t_k)) overlinemathcalF(f(t_k))$, where here $mathcalF$ is the discrete Fourier transform over some arbitrary window of data and $bar$ means complex conjugate. Let's assume that the SDF is the a-priori information I have available for defining the signal smoothness.



      I want to be able to define sequential or batch estimation algorithms to estimate this signal given noisy measurements. For simplicity, let's say:



      $$
      y(t_k) = f(t_k) + w(t_k)
      $$



      is our measurement, where $E[w(t_k)w(t_l)] = sigma^2delta(k-l)$, where $sigma^2$ is the noise variance and $delta$ is the Dirac delta function.



      If I want to predict/estimate $hatf(t_k)$ given past estimates $hatf(t_k-1), hatf(t_k-2), dots $, one way to do this is using an auto-regressive (AR) model:



      $$
      hatf(t_k) = c + sum_i=1^P a_i hatf(t_k-i)
      $$



      where $c$ and $a_i$ are model coefficients. (There is a direct relationship between an AR model and its corresponding power spectral density, correct?)



      Another way is by estimating and using derivatives of $f(t_k-1)$:



      $$
      hatf(t_k) = hatf(t_k-1) + Delta t hatdotf(t_k-1) + fracDelta t2 hatddotf(t_k-1) + cdots
      $$



      where $Delta t = t_k - t_k-1$, $dotf$ denotes the first time derivative (i.e. rate) of $f$, and $ddotf$ denotes the second time derivative (i.e. acceleration) of $f$, etc. (I don't at all understand how this method of predicting $f$ relates to its power spectral density.)



      Intuitively, I feel there must be a relationship between these two ways of predicting/estimating a smooth function, but I can't quite pin it down, nor find any references that do. So...



      What is the relationship between using an auto-regressive model and using function derivatives to predict a smooth signal $f(t_k)$, particularly in regard to knowing a-priori its power spectral density $S_f(omega_k)$.




      Thank you for any help/guidance/direction. If this question belongs in another community, please let me know.










      share|cite|improve this question











      $endgroup$




      I have a discrete stochastic function $f(t_k)$ (in my case, it's a time signal related to atmospheric parameters). I know this function to have a certain smoothness. One way I can specify its smoothness is using its auto-correlation function, or equivalently, its power spectral density which can be estimated by $S_f(omega_k) = mathcalF(f(t_k)) overlinemathcalF(f(t_k))$, where here $mathcalF$ is the discrete Fourier transform over some arbitrary window of data and $bar$ means complex conjugate. Let's assume that the SDF is the a-priori information I have available for defining the signal smoothness.



      I want to be able to define sequential or batch estimation algorithms to estimate this signal given noisy measurements. For simplicity, let's say:



      $$
      y(t_k) = f(t_k) + w(t_k)
      $$



      is our measurement, where $E[w(t_k)w(t_l)] = sigma^2delta(k-l)$, where $sigma^2$ is the noise variance and $delta$ is the Dirac delta function.



      If I want to predict/estimate $hatf(t_k)$ given past estimates $hatf(t_k-1), hatf(t_k-2), dots $, one way to do this is using an auto-regressive (AR) model:



      $$
      hatf(t_k) = c + sum_i=1^P a_i hatf(t_k-i)
      $$



      where $c$ and $a_i$ are model coefficients. (There is a direct relationship between an AR model and its corresponding power spectral density, correct?)



      Another way is by estimating and using derivatives of $f(t_k-1)$:



      $$
      hatf(t_k) = hatf(t_k-1) + Delta t hatdotf(t_k-1) + fracDelta t2 hatddotf(t_k-1) + cdots
      $$



      where $Delta t = t_k - t_k-1$, $dotf$ denotes the first time derivative (i.e. rate) of $f$, and $ddotf$ denotes the second time derivative (i.e. acceleration) of $f$, etc. (I don't at all understand how this method of predicting $f$ relates to its power spectral density.)



      Intuitively, I feel there must be a relationship between these two ways of predicting/estimating a smooth function, but I can't quite pin it down, nor find any references that do. So...



      What is the relationship between using an auto-regressive model and using function derivatives to predict a smooth signal $f(t_k)$, particularly in regard to knowing a-priori its power spectral density $S_f(omega_k)$.




      Thank you for any help/guidance/direction. If this question belongs in another community, please let me know.







      derivatives stochastic-processes signal-processing time-series discrete-time






      share|cite|improve this question















      share|cite|improve this question













      share|cite|improve this question




      share|cite|improve this question








      edited Mar 4 at 8:02







      Brian

















      asked Mar 1 at 22:14









      BrianBrian

      260214




      260214






      This question has an open bounty worth +50
      reputation from Brian ending ending at 2019-03-11 08:04:20Z">tomorrow.


      Looking for an answer drawing from credible and/or official sources.


      Please help me (and others) understand the relationship between auto-regressive models and function derivatives.








      This question has an open bounty worth +50
      reputation from Brian ending ending at 2019-03-11 08:04:20Z">tomorrow.


      Looking for an answer drawing from credible and/or official sources.


      Please help me (and others) understand the relationship between auto-regressive models and function derivatives.






















          1 Answer
          1






          active

          oldest

          votes


















          0












          $begingroup$

          From the point of view of radiolocation, the general task can be divided into two parts: the consideration of jamming trends and the allocation of signal information. As far as I understand the essence of the issue, in meteorology the same information can be perceived as an interfering trend (with a short-term forecast), and as signaling information (with a long-term one).



          Time trends (including polynomial one) can be used to equalize the signal level at the edges of the samples, which eliminates the use of weight windows that reduce the resolution of the DFT.



          The same task can be performed by methods based on an autoregressive smoothing model, for which fast algorithms also exist.



          Trends computed in the spectral region are used to normalize the density of the power spectrum. The alignment of the interference spectrum brings the consistent signal processing to the optimum.



          The signal spectrum is chaotic and poorly predictable. Non-parametric processing methods are better suited for it — for example, median filtering in a sliding window.




          Waiting for detalization in comments.






          share|cite|improve this answer









          $endgroup$












            Your Answer





            StackExchange.ifUsing("editor", function ()
            return StackExchange.using("mathjaxEditing", function ()
            StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
            StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
            );
            );
            , "mathjax-editing");

            StackExchange.ready(function()
            var channelOptions =
            tags: "".split(" "),
            id: "69"
            ;
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function()
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled)
            StackExchange.using("snippets", function()
            createEditor();
            );

            else
            createEditor();

            );

            function createEditor()
            StackExchange.prepareEditor(
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: true,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: 10,
            bindNavPrevention: true,
            postfix: "",
            imageUploader:
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            ,
            noCode: true, onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            );



            );













            draft saved

            draft discarded


















            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3131871%2fsmoothness-of-a-time-series-relationship-between-arma-model-and-signal-derivati%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown

























            1 Answer
            1






            active

            oldest

            votes








            1 Answer
            1






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            0












            $begingroup$

            From the point of view of radiolocation, the general task can be divided into two parts: the consideration of jamming trends and the allocation of signal information. As far as I understand the essence of the issue, in meteorology the same information can be perceived as an interfering trend (with a short-term forecast), and as signaling information (with a long-term one).



            Time trends (including polynomial one) can be used to equalize the signal level at the edges of the samples, which eliminates the use of weight windows that reduce the resolution of the DFT.



            The same task can be performed by methods based on an autoregressive smoothing model, for which fast algorithms also exist.



            Trends computed in the spectral region are used to normalize the density of the power spectrum. The alignment of the interference spectrum brings the consistent signal processing to the optimum.



            The signal spectrum is chaotic and poorly predictable. Non-parametric processing methods are better suited for it — for example, median filtering in a sliding window.




            Waiting for detalization in comments.






            share|cite|improve this answer









            $endgroup$

















              0












              $begingroup$

              From the point of view of radiolocation, the general task can be divided into two parts: the consideration of jamming trends and the allocation of signal information. As far as I understand the essence of the issue, in meteorology the same information can be perceived as an interfering trend (with a short-term forecast), and as signaling information (with a long-term one).



              Time trends (including polynomial one) can be used to equalize the signal level at the edges of the samples, which eliminates the use of weight windows that reduce the resolution of the DFT.



              The same task can be performed by methods based on an autoregressive smoothing model, for which fast algorithms also exist.



              Trends computed in the spectral region are used to normalize the density of the power spectrum. The alignment of the interference spectrum brings the consistent signal processing to the optimum.



              The signal spectrum is chaotic and poorly predictable. Non-parametric processing methods are better suited for it — for example, median filtering in a sliding window.




              Waiting for detalization in comments.






              share|cite|improve this answer









              $endgroup$















                0












                0








                0





                $begingroup$

                From the point of view of radiolocation, the general task can be divided into two parts: the consideration of jamming trends and the allocation of signal information. As far as I understand the essence of the issue, in meteorology the same information can be perceived as an interfering trend (with a short-term forecast), and as signaling information (with a long-term one).



                Time trends (including polynomial one) can be used to equalize the signal level at the edges of the samples, which eliminates the use of weight windows that reduce the resolution of the DFT.



                The same task can be performed by methods based on an autoregressive smoothing model, for which fast algorithms also exist.



                Trends computed in the spectral region are used to normalize the density of the power spectrum. The alignment of the interference spectrum brings the consistent signal processing to the optimum.



                The signal spectrum is chaotic and poorly predictable. Non-parametric processing methods are better suited for it — for example, median filtering in a sliding window.




                Waiting for detalization in comments.






                share|cite|improve this answer









                $endgroup$



                From the point of view of radiolocation, the general task can be divided into two parts: the consideration of jamming trends and the allocation of signal information. As far as I understand the essence of the issue, in meteorology the same information can be perceived as an interfering trend (with a short-term forecast), and as signaling information (with a long-term one).



                Time trends (including polynomial one) can be used to equalize the signal level at the edges of the samples, which eliminates the use of weight windows that reduce the resolution of the DFT.



                The same task can be performed by methods based on an autoregressive smoothing model, for which fast algorithms also exist.



                Trends computed in the spectral region are used to normalize the density of the power spectrum. The alignment of the interference spectrum brings the consistent signal processing to the optimum.



                The signal spectrum is chaotic and poorly predictable. Non-parametric processing methods are better suited for it — for example, median filtering in a sliding window.




                Waiting for detalization in comments.







                share|cite|improve this answer












                share|cite|improve this answer



                share|cite|improve this answer










                answered yesterday









                Yuri NegometyanovYuri Negometyanov

                11.9k1729




                11.9k1729



























                    draft saved

                    draft discarded
















































                    Thanks for contributing an answer to Mathematics Stack Exchange!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid


                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.

                    Use MathJax to format equations. MathJax reference.


                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function ()
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3131871%2fsmoothness-of-a-time-series-relationship-between-arma-model-and-signal-derivati%23new-answer', 'question_page');

                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    Moe incest case Sentencing See also References Navigation menu"'Australian Josef Fritzl' fathered four children by daughter""Small town recoils in horror at 'Australian Fritzl' incest case""Victorian rape allegations echo Fritzl case - Just In (Australian Broadcasting Corporation)""Incest father jailed for 22 years""'Australian Fritzl' sentenced to 22 years in prison for abusing daughter for three decades""RSJ v The Queen"

                    Who is our nearest planetary neighbor, on average?Santa Claus flies to the South PoleSeven Spheres of Unequal Mass, a weighing problem with a twistDescribe a large integerFast Mental Calculation of $7.5^7$Math in Space (without the help of celebrities)Find the value of $bigstar$: Puzzle 8 - InequalityWho drinks beer while running anyway?A Crucial DeliveryRanking And AverageHow long will my money last at roulette?

                    Daza language Contents Vocabulary Phonology References External links Navigation menudaza1242Daza"Dazaga"eeee178086576